[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:25 dist-test-slave-f0tn krb5kdc[17493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:25 dist-test-slave-f0tn krb5kdc[17493](info): set up 2 sockets
Aug 06 19:27:25 dist-test-slave-f0tn krb5kdc[17493](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 19:27:26.892591 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.006s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:27 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:27.127683 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36765
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:36765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:27.567363 17510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:27.567878 17510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:27.568059 17510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:27.578229 17510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:27.578572 17510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:27.578775 17510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:27.579015 17510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:27.579326 17510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:27.594169 17510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:36765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:27.596432 17510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:27.598856 17510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:27.626076 17518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:27.626089 17516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:27.626292 17520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:27.632342 17510 server_base.cc:1034] running on GCE node
I20260806 19:27:27.633816 17510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:27.636783 17510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:27.638288 17510 hybrid_clock.cc:648] HybridClock initialized: now 1786044447638089 us; error 104 us; skew 500 ppm
I20260806 19:27:27.639063 17510 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:27 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044447, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:27.644550 17510 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:27.647632 17510 webserver.cc:460] Webserver started at http://127.17.18.126:42439/ using document root <none> and password file <none>
I20260806 19:27:27.648979 17510 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:27.649152 17510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:27.649751 17510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:27.654346 17510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "93356f5671084fe185d259c1858e8268"
format_stamp: "Formatted at 2026-08-06 19:27:27 on dist-test-slave-f0tn"
server_key: "bd7142ac2001a6228858f564a7266a32"
server_key_iv: "ef9ba6ad0e93d64702f10284ad0fa757"
server_key_version: "encryptionkey@0"
I20260806 19:27:27.655269 17510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "93356f5671084fe185d259c1858e8268"
format_stamp: "Formatted at 2026-08-06 19:27:27 on dist-test-slave-f0tn"
server_key: "bd7142ac2001a6228858f564a7266a32"
server_key_iv: "ef9ba6ad0e93d64702f10284ad0fa757"
server_key_version: "encryptionkey@0"
I20260806 19:27:27.665616 17510 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.011s sys 0.000s
I20260806 19:27:27.673642 17533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:27.676219 17510 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.007s sys 0.000s
I20260806 19:27:27.676611 17510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "93356f5671084fe185d259c1858e8268"
format_stamp: "Formatted at 2026-08-06 19:27:27 on dist-test-slave-f0tn"
server_key: "bd7142ac2001a6228858f564a7266a32"
server_key_iv: "ef9ba6ad0e93d64702f10284ad0fa757"
server_key_version: "encryptionkey@0"
I20260806 19:27:27.676888 17510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:27.702330 17510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:27.710928 17510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:27.711584 17510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:27.752770 17510 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:36765
I20260806 19:27:27.752784 17607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:36765 every 8 connection(s)
I20260806 19:27:27.755568 17510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:27.763646 17608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:27.764572 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17510
I20260806 19:27:27.764935 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:27.767341 17481 external_mini_cluster.cc:1428] Setting key 975b68860a2b8c08a272df4e8d0c4018
I20260806 19:27:27.781759 17608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268: Bootstrap starting.
I20260806 19:27:27.789355 17608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:27.792886 17608 log.cc:824] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:27.799748 17608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268: No bootstrap required, opened a new log
Aug 06 19:27:27 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:27.817608 17608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } }
I20260806 19:27:27.818523 17608 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:27.818795 17608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93356f5671084fe185d259c1858e8268, State: Initialized, Role: FOLLOWER
I20260806 19:27:27.820398 17608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } }
I20260806 19:27:27.820911 17608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:27.821259 17608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:27.821646 17608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:27.824595 17608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } }
I20260806 19:27:27.825942 17608 leader_election.cc:302] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93356f5671084fe185d259c1858e8268; no voters:
I20260806 19:27:27.826924 17608 leader_election.cc:288] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:27.827232 17614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:27.831280 17608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:27.833282 17611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:27.773932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48994 (local address 127.17.18.126:36765)
0806 19:27:27.775170 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:27.775190 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:27.778444 (+ 3254us) server_negotiation.cc:407] Connection header received
0806 19:27:27.795370 (+ 16926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:27.795402 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:27.796375 (+ 973us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:27.797048 (+ 673us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:27.802261 (+ 5213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:27.805572 (+ 3311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:27.808583 (+ 3011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:27.810350 (+ 1767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:27.810692 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:27.820098 (+ 9406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:27.820176 (+ 78us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:27.820230 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:27.820337 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:27.825219 (+ 4882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:27.826759 (+ 1540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:27.826768 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:27.826776 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:27.827154 (+ 378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:27.827951 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:27.827957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:27.827959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:27.829078 (+ 1119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:27.829602 (+ 524us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:27.830724 (+ 1122us) server_negotiation.cc:299] Negotiation successful
0806 19:27:27.831195 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":424,"threads_started":1}
I20260806 19:27:27.833843 17614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [term 1 LEADER]: Becoming Leader. State: Replica: 93356f5671084fe185d259c1858e8268, State: Running, Role: LEADER
I20260806 19:27:27.835155 17614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } }
I20260806 19:27:27.843150 17616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93356f5671084fe185d259c1858e8268. Latest consensus state: current_term: 1 leader_uuid: "93356f5671084fe185d259c1858e8268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } } }
I20260806 19:27:27.843557 17615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93356f5671084fe185d259c1858e8268" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93356f5671084fe185d259c1858e8268" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36765 } } }
I20260806 19:27:27.845192 17616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:27.845229 17615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:27.849866 17627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:27.863405 17627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:27.888903 17627 catalog_manager.cc:1347] Generated new cluster ID: 279cb2d27abf41f1a6f1028baa779d4c
I20260806 19:27:27.889108 17627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:27.916056 17627 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:27.918437 17627 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:27.929486 17627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93356f5671084fe185d259c1858e8268: Generated new TSK 0
I20260806 19:27:27.930845 17627 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:28.006827 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:28.787101 17639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:28.787595 17639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:28.787994 17639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:28.801312 17639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:28.801666 17639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:28.801967 17639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:27:28.819836 17639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:28.821796 17639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:28.823832 17639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:28.848716 17648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:28.848973 17647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:28.848865 17651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:28.850780 17639 server_base.cc:1034] running on GCE node
I20260806 19:27:28.851675 17639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:28.853029 17639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:28.854319 17639 hybrid_clock.cc:648] HybridClock initialized: now 1786044448854229 us; error 41 us; skew 500 ppm
I20260806 19:27:28.854770 17639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:28 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044448, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:28.860601 17639 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:27:28.863129 17639 webserver.cc:460] Webserver started at http://127.17.18.65:39677/ using document root <none> and password file <none>
I20260806 19:27:28.864189 17639 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:28.864432 17639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:28.864940 17639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:28.869915 17639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "0a2a9fb541bf4744bfd191245cc1cdd3"
format_stamp: "Formatted at 2026-08-06 19:27:28 on dist-test-slave-f0tn"
server_key: "8ac4dc3118683569f87e471a935a70b6"
server_key_iv: "0497816c60ab7ff1b7f90adc268fcc26"
server_key_version: "encryptionkey@0"
I20260806 19:27:28.871093 17639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "0a2a9fb541bf4744bfd191245cc1cdd3"
format_stamp: "Formatted at 2026-08-06 19:27:28 on dist-test-slave-f0tn"
server_key: "8ac4dc3118683569f87e471a935a70b6"
server_key_iv: "0497816c60ab7ff1b7f90adc268fcc26"
server_key_version: "encryptionkey@0"
I20260806 19:27:28.879666 17639 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260806 19:27:28.886221 17662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:28.888262 17639 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260806 19:27:28.888553 17639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "0a2a9fb541bf4744bfd191245cc1cdd3"
format_stamp: "Formatted at 2026-08-06 19:27:28 on dist-test-slave-f0tn"
server_key: "8ac4dc3118683569f87e471a935a70b6"
server_key_iv: "0497816c60ab7ff1b7f90adc268fcc26"
server_key_version: "encryptionkey@0"
I20260806 19:27:28.888924 17639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:28.917845 17639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:28.925556 17639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:28.926151 17639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:28.928234 17639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:28.931345 17639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:28.931516 17639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:28.931851 17639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:28.931979 17639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:29.040234 17639 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:39449
I20260806 19:27:29.040524 17820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:39449 every 8 connection(s)
I20260806 19:27:29.042102 17639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:27:29.051354 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17639
I20260806 19:27:29.051786 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:27:29.052969 17481 external_mini_cluster.cc:1428] Setting key a0eef61b32421f43d2546d30b9705a9c
Aug 06 19:27:29 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044448, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:27:29.079041 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:29.046802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:37665 (local address 127.17.18.126:36765)
0806 19:27:29.047916 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:29.047924 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:29.048715 (+ 791us) server_negotiation.cc:407] Connection header received
0806 19:27:29.053020 (+ 4305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:29.053025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:29.053143 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:29.053270 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:29.056377 (+ 3107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:29.057716 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:29.061200 (+ 3484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:29.062250 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:29.062407 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:29.068699 (+ 6292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:29.068712 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:29.068718 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:29.068774 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:29.073946 (+ 5172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:29.075137 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:29.075144 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:29.075148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:29.075442 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:29.076189 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:29.076193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:29.076196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:29.076629 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:29.076788 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:29.077872 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0806 19:27:29.078205 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":957,"thread_start_us":740,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
I20260806 19:27:29.080413 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:29.047411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36765 (local address 127.17.18.65:37665)
0806 19:27:29.048540 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:29.048583 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:29.052565 (+ 3982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:29.053721 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:29.053736 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:29.054798 (+ 1062us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:29.056103 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:29.056137 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:29.057944 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:29.057951 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:29.060955 (+ 3004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:29.060978 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:29.062758 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:29.062777 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:29.063560 (+ 783us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:29.064671 (+ 1111us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:29.064699 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:29.068140 (+ 3441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:29.074194 (+ 6054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:29.074205 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:29.074223 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:29.074948 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:29.075641 (+ 693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:29.075646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:29.075648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:29.076013 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:29.076848 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:29.076856 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:29.077326 (+ 470us) client_negotiation.cc:769] Sending connection context
0806 19:27:29.077739 (+ 413us) client_negotiation.cc:240] Negotiation successful
0806 19:27:29.078503 (+ 764us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"thread_start_us":496,"threads_started":1}
I20260806 19:27:29.082741 17821 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36765
I20260806 19:27:29.083420 17821 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:29.084803 17821 heartbeater.cc:511] Master 127.17.18.126:36765 requested a full tablet report, sending...
I20260806 19:27:29.090049 17558 ts_manager.cc:194] Registered new tserver with Master: 0a2a9fb541bf4744bfd191245cc1cdd3 (127.17.18.65:39449)
I20260806 19:27:29.093240 17558 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:37665
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:27:29.114338 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:29.837198 17828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:29.837699 17828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:29.837946 17828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:29.849135 17828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:29.849372 17828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:29.849722 17828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:27:29.864553 17828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:29.866153 17828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:29.867898 17828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:29.886237 17835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:29.886406 17839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:29.886236 17836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:29.888458 17828 server_base.cc:1034] running on GCE node
I20260806 19:27:29.889302 17828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:29.890460 17828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:29.891762 17828 hybrid_clock.cc:648] HybridClock initialized: now 1786044449891637 us; error 53 us; skew 500 ppm
I20260806 19:27:29.892196 17828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:29 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:29.897594 17828 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:27:29.900139 17828 webserver.cc:460] Webserver started at http://127.17.18.66:42413/ using document root <none> and password file <none>
I20260806 19:27:29.901229 17828 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:29.901503 17828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:29.902043 17828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:29.907115 17828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "2aaf87e8ecb84658b8eba1790d043729"
format_stamp: "Formatted at 2026-08-06 19:27:29 on dist-test-slave-f0tn"
server_key: "c1dcfb7b9fab6fafb65def59212d9efe"
server_key_iv: "a2899d7be7f92ee6daec3d56783e3176"
server_key_version: "encryptionkey@0"
I20260806 19:27:29.908279 17828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "2aaf87e8ecb84658b8eba1790d043729"
format_stamp: "Formatted at 2026-08-06 19:27:29 on dist-test-slave-f0tn"
server_key: "c1dcfb7b9fab6fafb65def59212d9efe"
server_key_iv: "a2899d7be7f92ee6daec3d56783e3176"
server_key_version: "encryptionkey@0"
I20260806 19:27:29.916803 17828 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.009s
I20260806 19:27:29.923451 17851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:29.925846 17828 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:27:29.926136 17828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "2aaf87e8ecb84658b8eba1790d043729"
format_stamp: "Formatted at 2026-08-06 19:27:29 on dist-test-slave-f0tn"
server_key: "c1dcfb7b9fab6fafb65def59212d9efe"
server_key_iv: "a2899d7be7f92ee6daec3d56783e3176"
server_key_version: "encryptionkey@0"
I20260806 19:27:29.926503 17828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:29.965263 17828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:29.972831 17828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:29.973371 17828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:29.975422 17828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:29.978160 17828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:29.978345 17828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:29.978539 17828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:29.978803 17828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:30.076406 17828 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:33747
I20260806 19:27:30.076577 18004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:33747 every 8 connection(s)
I20260806 19:27:30.078434 17828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:27:30.086951 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17828
I20260806 19:27:30.087282 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:27:30.087904 17481 external_mini_cluster.cc:1428] Setting key ebf6d151b58145859c77c5730b07b4d4
I20260806 19:27:30.098664 17821 heartbeater.cc:503] Master 127.17.18.126:36765 was elected leader, sending a full tablet report...
Aug 06 19:27:30 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044449, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
I20260806 19:27:30.115298 18007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:30.082978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:60609 (local address 127.17.18.126:36765)
0806 19:27:30.083940 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:30.083945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:30.086067 (+ 2122us) server_negotiation.cc:407] Connection header received
0806 19:27:30.089780 (+ 3713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:30.089785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:30.089864 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:30.089973 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:30.092655 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:30.094194 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:30.097426 (+ 3232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:30.098405 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:30.098686 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:30.105117 (+ 6431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:30.105131 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:30.105137 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:30.105254 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:30.110884 (+ 5630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:30.111980 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:30.111985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:30.111988 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:30.112261 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:30.112863 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:30.112868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:30.112870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:30.113289 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:30.113534 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:30.114390 (+ 856us) server_negotiation.cc:299] Negotiation successful
0806 19:27:30.114751 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":586,"threads_started":1}
I20260806 19:27:30.116417 18008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:30.084191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36765 (local address 127.17.18.66:60609)
0806 19:27:30.085848 (+ 1657us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:30.085906 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:30.089318 (+ 3412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:30.090335 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:30.090350 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:30.091320 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:30.092373 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:30.092403 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:30.094638 (+ 2235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:30.094644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:30.097132 (+ 2488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:30.097157 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:30.098956 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:30.098968 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:30.099580 (+ 612us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:30.100756 (+ 1176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:30.100785 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:30.104670 (+ 3885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:30.111130 (+ 6460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:30.111143 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:30.111162 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:30.111822 (+ 660us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:30.112415 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:30.112419 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:30.112422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:30.112720 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:30.113497 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:30.113507 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:30.113961 (+ 454us) client_negotiation.cc:769] Sending connection context
0806 19:27:30.114264 (+ 303us) client_negotiation.cc:240] Negotiation successful
0806 19:27:30.114949 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1314,"thread_start_us":887,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
I20260806 19:27:30.118932 18005 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36765
I20260806 19:27:30.119834 18005 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:30.120728 18005 heartbeater.cc:511] Master 127.17.18.126:36765 requested a full tablet report, sending...
I20260806 19:27:30.123065 17558 ts_manager.cc:194] Registered new tserver with Master: 2aaf87e8ecb84658b8eba1790d043729 (127.17.18.66:33747)
I20260806 19:27:30.124229 17558 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:60609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:27:30.159413 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:30.811553 18018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:30.811982 18018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:30.812321 18018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:30.823261 18018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:30.823583 18018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:30.823822 18018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:27:30.838759 18018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36765
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:30.840585 18018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:30.842662 18018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:30.863910 18024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:30.865118 18025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:30.865402 18027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:30.866818 18018 server_base.cc:1034] running on GCE node
I20260806 19:27:30.867657 18018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:30.869038 18018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:30.870428 18018 hybrid_clock.cc:648] HybridClock initialized: now 1786044450870277 us; error 95 us; skew 500 ppm
I20260806 19:27:30.870936 18018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:30 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044450, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:30.881757 18018 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:27:30.884236 18018 webserver.cc:460] Webserver started at http://127.17.18.67:37199/ using document root <none> and password file <none>
I20260806 19:27:30.885517 18018 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:30.885793 18018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:30.886264 18018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:30.890236 18018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "9aabf5929eab40f2a92517257619e182"
format_stamp: "Formatted at 2026-08-06 19:27:30 on dist-test-slave-f0tn"
server_key: "c6fc8c2ab240ac46c26e270992ff5d1d"
server_key_iv: "0993db931d8bd30321bedb5adec8ca9a"
server_key_version: "encryptionkey@0"
I20260806 19:27:30.891287 18018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "9aabf5929eab40f2a92517257619e182"
format_stamp: "Formatted at 2026-08-06 19:27:30 on dist-test-slave-f0tn"
server_key: "c6fc8c2ab240ac46c26e270992ff5d1d"
server_key_iv: "0993db931d8bd30321bedb5adec8ca9a"
server_key_version: "encryptionkey@0"
I20260806 19:27:30.900534 18018 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260806 19:27:30.906178 18036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:30.908254 18018 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260806 19:27:30.908558 18018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "9aabf5929eab40f2a92517257619e182"
format_stamp: "Formatted at 2026-08-06 19:27:30 on dist-test-slave-f0tn"
server_key: "c6fc8c2ab240ac46c26e270992ff5d1d"
server_key_iv: "0993db931d8bd30321bedb5adec8ca9a"
server_key_version: "encryptionkey@0"
I20260806 19:27:30.908895 18018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:30.936787 18018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:30.943915 18018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:30.944391 18018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:30.945946 18018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:30.948664 18018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:30.948889 18018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:30.949168 18018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:30.949295 18018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:31.035851 18018 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:32809
I20260806 19:27:31.035985 18186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:32809 every 8 connection(s)
I20260806 19:27:31.037988 18018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:27:31.044143 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18018
I20260806 19:27:31.044399 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:27:31.045006 17481 external_mini_cluster.cc:1428] Setting key ecd6a600986a866ce8440d23b8d57737
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044450, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:31.075991 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.042311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:58315 (local address 127.17.18.126:36765)
0806 19:27:31.043303 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.043310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.046629 (+ 3319us) server_negotiation.cc:407] Connection header received
0806 19:27:31.050817 (+ 4188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.050822 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.050976 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.051217 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.054357 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.055497 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.058839 (+ 3342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.059630 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.059773 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.065885 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.065892 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.065895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.065941 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.071098 (+ 5157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.072328 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.072333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.072336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.072608 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.073273 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.073278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.073280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.073726 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.073877 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.075134 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.075443 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"thread_start_us":596,"threads_started":1}
I20260806 19:27:31.077044 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.043212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36765 (local address 127.17.18.67:58315)
0806 19:27:31.046388 (+ 3176us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:31.046462 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:31.050356 (+ 3894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:31.051457 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:31.051472 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:31.052552 (+ 1080us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:31.053916 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:31.054002 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.055771 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.055776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:31.058580 (+ 2804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:31.058606 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.060094 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.060105 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:31.060409 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.061441 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:31.061483 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:31.065502 (+ 4019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:31.071373 (+ 5871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:31.071384 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:31.071403 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:31.072151 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:31.072754 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:31.072759 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:31.072761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:31.073128 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:31.073877 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:31.073887 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:31.074404 (+ 517us) client_negotiation.cc:769] Sending connection context
0806 19:27:31.074768 (+ 364us) client_negotiation.cc:240] Negotiation successful
0806 19:27:31.075420 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2781,"thread_start_us":2490,"threads_started":1}
I20260806 19:27:31.079159 18187 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36765
I20260806 19:27:31.079551 18187 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:31.080979 18187 heartbeater.cc:511] Master 127.17.18.126:36765 requested a full tablet report, sending...
I20260806 19:27:31.083560 17558 ts_manager.cc:194] Registered new tserver with Master: 9aabf5929eab40f2a92517257619e182 (127.17.18.67:32809)
I20260806 19:27:31.084672 17558 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:58315
I20260806 19:27:31.090415 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
I20260806 19:27:31.128733 18005 heartbeater.cc:503] Master 127.17.18.126:36765 was elected leader, sending a full tablet report...
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:31.159559 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.135296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38406 (local address 127.17.18.65:39449)
0806 19:27:31.136398 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.136410 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.136868 (+ 458us) server_negotiation.cc:407] Connection header received
0806 19:27:31.136980 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.136988 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.137257 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.137435 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.140590 (+ 3155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.142040 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.144377 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.145216 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.145354 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.152009 (+ 6655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.152029 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.152050 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.152114 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.155270 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.156445 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.156455 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.156458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.156660 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.157470 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.157475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.157477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.157959 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.158419 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.158882 (+ 463us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.159160 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":860,"thread_start_us":566,"threads_started":1}
W20260806 19:27:31.161656 17700 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38406
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:31.219475 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.201809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38416 (local address 127.17.18.65:39449)
0806 19:27:31.202112 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.202117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.202338 (+ 221us) server_negotiation.cc:407] Connection header received
0806 19:27:31.202543 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.202548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.202665 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.202770 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.204237 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.204968 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.206394 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.206848 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.206964 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.212724 (+ 5760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.212730 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.212734 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.212784 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.216148 (+ 3364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.217347 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.217353 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.217355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.217579 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.218060 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.218065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.218069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.218369 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.218586 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.218969 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.219198 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260806 19:27:31.221927 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17639
I20260806 19:27:31.239871 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.223223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38422 (local address 127.17.18.65:39449)
0806 19:27:31.223448 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.223455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.223782 (+ 327us) server_negotiation.cc:407] Connection header received
0806 19:27:31.223941 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.223946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.224058 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.224164 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.226158 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.226936 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.228845 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.229291 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.229487 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.232248 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.232254 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.232257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.232314 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.235625 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.236646 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.236664 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.236666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.236959 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.237720 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.237726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.237730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.238140 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.238355 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.239238 (+ 883us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.239453 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:27:31.240939 17814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:31.336263 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17639
I20260806 19:27:31.360913 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17828
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:27:31.379967 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.362405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51406 (local address 127.17.18.66:33747)
0806 19:27:31.363173 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.363180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.363214 (+ 34us) server_negotiation.cc:407] Connection header received
0806 19:27:31.363285 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.363291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.363528 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.363667 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.365202 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.366561 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.367940 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.368621 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.368737 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.373261 (+ 4524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.373276 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.373295 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.373348 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.376676 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.377573 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.377583 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.377585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.377744 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.378173 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.378177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.378180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.378645 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.378936 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.379282 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.379542 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":362,"threads_started":1}
I20260806 19:27:31.381352 17997 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:31.467495 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17828
I20260806 19:27:31.491325 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18018
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:27:31.509934 18210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:31.492407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57600 (local address 127.17.18.67:32809)
0806 19:27:31.492944 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:31.492952 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:31.492983 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:27:31.493059 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:31.493066 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:31.493289 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:31.493464 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:31.494830 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.495860 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.497267 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:31.498025 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:31.498162 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:31.502916 (+ 4754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:31.502935 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:31.502955 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:31.503095 (+ 140us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:31.506461 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.507420 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.507429 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.507431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.507607 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:31.508127 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:31.508132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:31.508134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:31.508600 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:31.508877 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:31.509296 (+ 419us) server_negotiation.cc:299] Negotiation successful
0806 19:27:31.509607 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":240,"threads_started":1}
I20260806 19:27:31.511334 18179 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:31.598395 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18018
I20260806 19:27:31.621214 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17510
I20260806 19:27:31.622597 17602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:31.734429 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17510
2026-08-06T19:27:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (6140 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[18218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[18218](info): set up 2 sockets
Aug 06 19:27:31 dist-test-slave-f0tn krb5kdc[18218](info): commencing operation
krb5kdc: starting...
W20260806 19:27:32.960105 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.004s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:33 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:33.178768 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45287
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:33.539880 18237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:33.540234 18237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:33.540356 18237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:33.548426 18237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:33.548585 18237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:33.548668 18237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:33.548753 18237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:33.548820 18237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:33.560091 18237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:33.561611 18237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:33.563025 18237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:33.575403 18248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:33.575467 18250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:33.575426 18246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:33.576617 18237 server_base.cc:1034] running on GCE node
I20260806 19:27:33.577611 18237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:33.579195 18237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:33.580410 18237 hybrid_clock.cc:648] HybridClock initialized: now 1786044453580351 us; error 43 us; skew 500 ppm
I20260806 19:27:33.580787 18237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:33 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044453, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:33.584350 18237 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:33.586210 18237 webserver.cc:460] Webserver started at http://127.17.18.126:36513/ using document root <none> and password file <none>
I20260806 19:27:33.587038 18237 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:33.587178 18237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:33.587519 18237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:33.590965 18237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "d6f09e1c7e99454aafb399063182ec05"
format_stamp: "Formatted at 2026-08-06 19:27:33 on dist-test-slave-f0tn"
server_key: "91c9f12fb09177f9a5d45bbde48d0efb"
server_key_iv: "6de293711ec671263b72e60e8733b3c0"
server_key_version: "encryptionkey@0"
I20260806 19:27:33.591828 18237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "d6f09e1c7e99454aafb399063182ec05"
format_stamp: "Formatted at 2026-08-06 19:27:33 on dist-test-slave-f0tn"
server_key: "91c9f12fb09177f9a5d45bbde48d0efb"
server_key_iv: "6de293711ec671263b72e60e8733b3c0"
server_key_version: "encryptionkey@0"
I20260806 19:27:33.598203 18237 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.007s
I20260806 19:27:33.602798 18258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:33.604538 18237 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260806 19:27:33.604779 18237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "d6f09e1c7e99454aafb399063182ec05"
format_stamp: "Formatted at 2026-08-06 19:27:33 on dist-test-slave-f0tn"
server_key: "91c9f12fb09177f9a5d45bbde48d0efb"
server_key_iv: "6de293711ec671263b72e60e8733b3c0"
server_key_version: "encryptionkey@0"
I20260806 19:27:33.605237 18237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:33.636443 18237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:33.641794 18237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:33.642127 18237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:33.661625 18237 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45287
I20260806 19:27:33.661657 18329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45287 every 8 connection(s)
I20260806 19:27:33.663137 18237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:33.667270 18330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:33.671559 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18237
I20260806 19:27:33.671801 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:33.672438 17481 external_mini_cluster.cc:1428] Setting key bbe3db059abb5dd38ffe7197cea724d1
I20260806 19:27:33.679531 18330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05: Bootstrap starting.
I20260806 19:27:33.683116 18330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:33.684929 18330 log.cc:824] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:27:33 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:33.688377 18330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05: No bootstrap required, opened a new log
I20260806 19:27:33.696839 18330 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } }
I20260806 19:27:33.697301 18330 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:33.697417 18330 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f09e1c7e99454aafb399063182ec05, State: Initialized, Role: FOLLOWER
I20260806 19:27:33.697806 18335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:33.674701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52594 (local address 127.17.18.126:45287)
0806 19:27:33.675589 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:33.675603 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:33.675661 (+ 58us) server_negotiation.cc:407] Connection header received
0806 19:27:33.678050 (+ 2389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:33.678084 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:33.678574 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:33.679019 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:33.680704 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:33.682191 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:33.683564 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:33.684739 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:33.684972 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:33.689462 (+ 4490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:33.689479 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:33.689498 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:33.689543 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:33.693118 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:33.693943 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:33.693951 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:33.693963 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:33.694168 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:33.694597 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:33.694600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:33.694602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:33.695252 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:33.695560 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:33.696130 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 19:27:33.696576 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":387,"threads_started":1}
I20260806 19:27:33.698151 18330 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } }
I20260806 19:27:33.698428 18330 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:33.698590 18330 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:33.698767 18330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:33.701300 18330 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } }
I20260806 19:27:33.701875 18330 leader_election.cc:302] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6f09e1c7e99454aafb399063182ec05; no voters:
I20260806 19:27:33.702442 18330 leader_election.cc:288] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:33.702597 18337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:33.703299 18337 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [term 1 LEADER]: Becoming Leader. State: Replica: d6f09e1c7e99454aafb399063182ec05, State: Running, Role: LEADER
I20260806 19:27:33.703913 18337 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } }
I20260806 19:27:33.704619 18330 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:33.707100 18339 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6f09e1c7e99454aafb399063182ec05. Latest consensus state: current_term: 1 leader_uuid: "d6f09e1c7e99454aafb399063182ec05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } } }
I20260806 19:27:33.707585 18339 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:33.707062 18338 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6f09e1c7e99454aafb399063182ec05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6f09e1c7e99454aafb399063182ec05" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45287 } } }
I20260806 19:27:33.707978 18338 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:33.709458 18345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:33.715448 18345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:33.725353 18345 catalog_manager.cc:1347] Generated new cluster ID: 4cd352273eed432494ff362ea08a976b
I20260806 19:27:33.725533 18345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:33.737569 18345 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:33.738978 18345 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:33.747493 18345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6f09e1c7e99454aafb399063182ec05: Generated new TSK 0
I20260806 19:27:33.748485 18345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:33.805503 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:34.159761 18365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:34.160102 18365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:34.160247 18365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:34.167918 18365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:34.168068 18365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:34.168236 18365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:27:34.179636 18365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:34.181121 18365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:34.182623 18365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:34.196225 18376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:34.196251 18372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:34.196300 18373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:34.197278 18365 server_base.cc:1034] running on GCE node
I20260806 19:27:34.197971 18365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:34.198961 18365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:34.200234 18365 hybrid_clock.cc:648] HybridClock initialized: now 1786044454200143 us; error 64 us; skew 500 ppm
I20260806 19:27:34.200601 18365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:34 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044454, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:34.204020 18365 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:27:34.205732 18365 webserver.cc:460] Webserver started at http://127.17.18.65:44229/ using document root <none> and password file <none>
I20260806 19:27:34.206485 18365 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:34.206610 18365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:34.206930 18365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:34.210274 18365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "d741db41d6384e13f6690dea8be47799"
server_key_iv: "1b48527a3a2df5498f441a8061b66a65"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.211129 18365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "d741db41d6384e13f6690dea8be47799"
server_key_iv: "1b48527a3a2df5498f441a8061b66a65"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.217329 18365 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:27:34.221635 18385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.223301 18365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:34.223515 18365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "d741db41d6384e13f6690dea8be47799"
server_key_iv: "1b48527a3a2df5498f441a8061b66a65"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.223877 18365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:34.246609 18365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:34.252012 18365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:34.252627 18365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:34.254307 18365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:34.256601 18365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:34.256729 18365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.256870 18365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:34.256930 18365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.295248 18365 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:41279
I20260806 19:27:34.295276 18539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:41279 every 8 connection(s)
I20260806 19:27:34.296702 18365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:27:34.297864 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18365
I20260806 19:27:34.298149 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:27:34.298870 17481 external_mini_cluster.cc:1428] Setting key fd6bf16bfc126439dc4327c0a1ce5db3
Aug 06 19:27:34 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044454, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:27:34.321020 18543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:34.299618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:37855 (local address 127.17.18.126:45287)
0806 19:27:34.300150 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:34.300157 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:34.301330 (+ 1173us) server_negotiation.cc:407] Connection header received
0806 19:27:34.303765 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:34.303771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:34.303863 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:34.303966 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:34.305838 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.306672 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.308323 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.308903 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.309077 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:34.312966 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:34.312981 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:34.312986 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:34.313032 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:34.316622 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:34.317636 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:34.317643 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:34.317647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:34.317813 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:34.318394 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:34.318399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:34.318403 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:34.318789 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:34.318954 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:34.320499 (+ 1545us) server_negotiation.cc:299] Negotiation successful
0806 19:27:34.320711 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":242,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
I20260806 19:27:34.322206 18545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:34.300263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45287 (local address 127.17.18.65:37855)
0806 19:27:34.301164 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:34.301212 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:34.303420 (+ 2208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:34.304254 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:34.304264 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:34.304863 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:34.305640 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:34.305668 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.306854 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.306858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:34.308160 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:34.308175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.309183 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.309191 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:34.309488 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:34.310230 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:34.310256 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:34.312684 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:34.316849 (+ 4165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:34.316859 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:34.316882 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:34.317465 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:34.317980 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:34.317984 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:34.317987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:34.318241 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:34.319148 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:34.319160 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:34.319925 (+ 765us) client_negotiation.cc:769] Sending connection context
0806 19:27:34.320325 (+ 400us) client_negotiation.cc:240] Negotiation successful
0806 19:27:34.320836 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":312,"threads_started":1}
I20260806 19:27:34.324359 18540 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45287
I20260806 19:27:34.324730 18540 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:34.325618 18540 heartbeater.cc:511] Master 127.17.18.126:45287 requested a full tablet report, sending...
I20260806 19:27:34.328212 18280 ts_manager.cc:194] Registered new tserver with Master: 0a729c1ea3eb4a5e9724d1f42a07da4a (127.17.18.65:41279)
I20260806 19:27:34.330351 18280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:37855
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:27:34.353427 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:34.700196 18548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:34.700539 18548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:34.700683 18548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:34.709124 18548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:34.709307 18548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:34.709518 18548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:27:34.720922 18548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:34.722398 18548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:34.723917 18548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:34.738580 18555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:34.738473 18557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:34.738535 18554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:34.744871 18548 server_base.cc:1034] running on GCE node
I20260806 19:27:34.745749 18548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:34.746917 18548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:34.748147 18548 hybrid_clock.cc:648] HybridClock initialized: now 1786044454748095 us; error 46 us; skew 500 ppm
I20260806 19:27:34.748502 18548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:34 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044454, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:34.752002 18548 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:27:34.753782 18548 webserver.cc:460] Webserver started at http://127.17.18.66:44915/ using document root <none> and password file <none>
I20260806 19:27:34.754587 18548 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:34.754700 18548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:34.755023 18548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:34.758246 18548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "339b72a95b7c4cab8486111db14908f0"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "a83203942f85af534f129ae67ec0b558"
server_key_iv: "0a28c7ad45b738949c8c0115fc47b9e4"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.759122 18548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "339b72a95b7c4cab8486111db14908f0"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "a83203942f85af534f129ae67ec0b558"
server_key_iv: "0a28c7ad45b738949c8c0115fc47b9e4"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.765194 18548 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:27:34.769268 18566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.770960 18548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:27:34.771178 18548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "339b72a95b7c4cab8486111db14908f0"
format_stamp: "Formatted at 2026-08-06 19:27:34 on dist-test-slave-f0tn"
server_key: "a83203942f85af534f129ae67ec0b558"
server_key_iv: "0a28c7ad45b738949c8c0115fc47b9e4"
server_key_version: "encryptionkey@0"
I20260806 19:27:34.771420 18548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:34.801669 18548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:34.806671 18548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:34.806978 18548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:34.808085 18548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:34.809688 18548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:34.809768 18548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.809886 18548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:34.809934 18548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:34.843871 18548 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:35015
I20260806 19:27:34.843914 18721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:35015 every 8 connection(s)
I20260806 19:27:34.845230 18548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:27:34.845898 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18548
I20260806 19:27:34.846102 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:27:34.846704 17481 external_mini_cluster.cc:1428] Setting key 821829be05af85796538b0cc54ea9f72
Aug 06 19:27:34 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044454, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
I20260806 19:27:34.868891 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:34.848819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:34821 (local address 127.17.18.126:45287)
0806 19:27:34.849286 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:34.849292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:34.849958 (+ 666us) server_negotiation.cc:407] Connection header received
0806 19:27:34.851903 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:34.851909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:34.852001 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:34.852101 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:34.853883 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.854616 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.856964 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.857517 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.857640 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:34.862301 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:34.862307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:34.862311 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:34.862352 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:34.865050 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:34.866210 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:34.866215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:34.866217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:34.866366 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:34.866940 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:34.866945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:34.866947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:34.867275 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:34.867425 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:34.868307 (+ 882us) server_negotiation.cc:299] Negotiation successful
0806 19:27:34.868561 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":254,"threads_started":1}
I20260806 19:27:34.869788 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:34.848660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45287 (local address 127.17.18.66:34821)
0806 19:27:34.849795 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:34.849846 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:34.851596 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:34.852393 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:34.852402 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:34.852985 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:34.853678 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:34.853701 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.854803 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.854807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:34.856749 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:34.856776 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:34.857775 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:34.857782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:34.858075 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:34.858850 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:34.858880 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:34.861963 (+ 3083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:34.865279 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:34.865292 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:34.865314 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:34.866040 (+ 726us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:34.866496 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:34.866501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:34.866505 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:34.866793 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:34.867423 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:34.867434 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:34.867869 (+ 435us) client_negotiation.cc:769] Sending connection context
0806 19:27:34.868119 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 19:27:34.868590 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"thread_start_us":517,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
I20260806 19:27:34.871637 18722 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45287
I20260806 19:27:34.871977 18722 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:34.872800 18722 heartbeater.cc:511] Master 127.17.18.126:45287 requested a full tablet report, sending...
I20260806 19:27:34.874663 18280 ts_manager.cc:194] Registered new tserver with Master: 339b72a95b7c4cab8486111db14908f0 (127.17.18.66:35015)
I20260806 19:27:34.875803 18280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:34821
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:27:34.898299 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:35.259404 18728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:35.259768 18728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:35.259953 18728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:35.271868 18728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:35.272233 18728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:35.272565 18728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:27:35.286566 18728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45287
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:35.288174 18728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:35.290093 18728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:35.308784 18734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:35.309055 18735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:35.309691 18740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:35.311071 18728 server_base.cc:1034] running on GCE node
I20260806 19:27:35.312039 18728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:35.313293 18728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:35.314600 18728 hybrid_clock.cc:648] HybridClock initialized: now 1786044455314513 us; error 55 us; skew 500 ppm
I20260806 19:27:35.315017 18728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:35.319646 18728 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:27:35.321928 18728 webserver.cc:460] Webserver started at http://127.17.18.67:42743/ using document root <none> and password file <none>
I20260806 19:27:35.322844 18728 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:35.323032 18728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:35.323413 18728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:35.327023 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "4edb3b0445f04a47b0515506bda8d3be"
format_stamp: "Formatted at 2026-08-06 19:27:35 on dist-test-slave-f0tn"
server_key: "b6067e07433a204a6c50e1bfb38ef376"
server_key_iv: "1e86b5a59b8a4d332ae6d8fe39ea3bf7"
server_key_version: "encryptionkey@0"
I20260806 19:27:35.327915 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "4edb3b0445f04a47b0515506bda8d3be"
format_stamp: "Formatted at 2026-08-06 19:27:35 on dist-test-slave-f0tn"
server_key: "b6067e07433a204a6c50e1bfb38ef376"
server_key_iv: "1e86b5a59b8a4d332ae6d8fe39ea3bf7"
server_key_version: "encryptionkey@0"
I20260806 19:27:35.334844 18540 heartbeater.cc:503] Master 127.17.18.126:45287 was elected leader, sending a full tablet report...
I20260806 19:27:35.335234 18728 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.002s
I20260806 19:27:35.340683 18748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:35.342509 18728 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:27:35.342737 18728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "4edb3b0445f04a47b0515506bda8d3be"
format_stamp: "Formatted at 2026-08-06 19:27:35 on dist-test-slave-f0tn"
server_key: "b6067e07433a204a6c50e1bfb38ef376"
server_key_iv: "1e86b5a59b8a4d332ae6d8fe39ea3bf7"
server_key_version: "encryptionkey@0"
I20260806 19:27:35.343000 18728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:35.366981 18728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:35.372674 18728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:35.373323 18728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:35.374863 18728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:35.376672 18728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:35.376848 18728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:35.377101 18728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:35.377236 18728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:35.447537 18728 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:40909
I20260806 19:27:35.447767 18906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:40909 every 8 connection(s)
I20260806 19:27:35.449100 18728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:27:35.452248 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18728
I20260806 19:27:35.452476 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:27:35.453042 17481 external_mini_cluster.cc:1428] Setting key 9c2c542d69100a60467acb9599a4d95c
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:35.480379 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.452850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:55623 (local address 127.17.18.126:45287)
0806 19:27:35.453810 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.453816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.455388 (+ 1572us) server_negotiation.cc:407] Connection header received
0806 19:27:35.458784 (+ 3396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.458788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.458864 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.458968 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.461017 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.462240 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.464547 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.465346 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.465506 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.470932 (+ 5426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.470938 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.470941 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.470983 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.475289 (+ 4306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.476594 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.476599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.476602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.476787 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.477439 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.477443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.477445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.477791 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.478019 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.479283 (+ 1264us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.479705 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":818,"thread_start_us":551,"threads_started":1}
I20260806 19:27:35.481585 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.453937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45287 (local address 127.17.18.67:55623)
0806 19:27:35.455206 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.455267 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.458482 (+ 3215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.459225 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.459234 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.460033 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:35.460831 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.460854 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.462492 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.462497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.464338 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.464356 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.465660 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.465667 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.465924 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.466710 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:35.466735 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:35.470638 (+ 3903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:35.475505 (+ 4867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:35.475516 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:35.475542 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:35.476425 (+ 883us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:35.476937 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:35.476941 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:35.476943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:35.477273 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:35.477999 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:35.478009 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:35.478622 (+ 613us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.479144 (+ 522us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.479970 (+ 826us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"thread_start_us":604,"threads_started":1}
I20260806 19:27:35.483294 18908 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45287
I20260806 19:27:35.483665 18908 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:35.484603 18908 heartbeater.cc:511] Master 127.17.18.126:45287 requested a full tablet report, sending...
I20260806 19:27:35.486438 18280 ts_manager.cc:194] Registered new tserver with Master: 4edb3b0445f04a47b0515506bda8d3be (127.17.18.67:40909)
I20260806 19:27:35.487367 18280 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:55623
I20260806 19:27:35.496460 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:27:35.518730 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.504376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.17.18.126:45287)
0806 19:27:35.504567 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.504572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.505215 (+ 643us) server_negotiation.cc:407] Connection header received
0806 19:27:35.505417 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.505423 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.505504 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.505609 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.507260 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.508072 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.509565 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.510133 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.510278 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.512993 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.513024 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.513036 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.513084 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.515794 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.516573 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.516577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.516580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.516729 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.517203 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.517207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.517209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.517668 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.517883 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.518268 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.518463 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:27:35.528380 18280 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:35.537709 18280 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:35.569550 18930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.556781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:40909 (local address 127.0.0.1:51910)
0806 19:27:35.557849 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.557911 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.558182 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.559722 (+ 1540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.559732 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.559773 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:35.560248 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.560264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.563000 (+ 2736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.563008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.565835 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.565863 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.568286 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.568296 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.568580 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.568653 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.568809 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.569063 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":478,"threads_started":1}
I20260806 19:27:35.571692 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.557033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.17.18.67:40909)
0806 19:27:35.558919 (+ 1886us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.558929 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.558965 (+ 36us) server_negotiation.cc:407] Connection header received
0806 19:27:35.559076 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.559085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.559370 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.560534 (+ 1164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:35.560865 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.562773 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.566150 (+ 3377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.567957 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.570656 (+ 2699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.571028 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.571131 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.571325 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1689,"thread_start_us":2091,"threads_started":1}
I20260806 19:27:35.579281 18816 tablet_service.cc:1467] Processing CreateTablet for tablet b7d0660f693140e2bbada0c7f1c3c631 (DEFAULT_TABLE table=test-table [id=20cce543aafd41b0b776db6b509105b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:35.580325 18930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.557599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41279 (local address 127.0.0.1:51110)
0806 19:27:35.569908 (+ 12309us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.569934 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.570076 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.573357 (+ 3281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.573362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.573418 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:35.573620 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.573633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.576293 (+ 2660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.576299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.578154 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.578168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.579500 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.579507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.579720 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.579757 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.579835 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.580010 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12162,"thread_start_us":20094,"threads_started":1}
I20260806 19:27:35.580418 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.558180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51110 (local address 127.17.18.65:41279)
0806 19:27:35.572673 (+ 14493us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.572682 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.572716 (+ 34us) server_negotiation.cc:407] Connection header received
0806 19:27:35.572798 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.572804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.573101 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.573832 (+ 731us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:35.574576 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.576109 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.578322 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.579310 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.579460 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.579725 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.579924 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.580101 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14281,"thread_start_us":14420,"threads_started":1}
I20260806 19:27:35.581749 18816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d0660f693140e2bbada0c7f1c3c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:35.582827 18936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.558675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:35015 (local address 127.0.0.1:34806)
0806 19:27:35.572327 (+ 13652us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.572350 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.572507 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.573644 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.573648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.573671 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:35.574128 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.574146 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.577977 (+ 3831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.577982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.580024 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.580041 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.582214 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.582219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.582350 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.582376 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.582452 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.582556 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13494,"thread_start_us":13348,"threads_started":1}
I20260806 19:27:35.583081 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.558919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.17.18.66:35015)
0806 19:27:35.571609 (+ 12690us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.571618 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.572658 (+ 1040us) server_negotiation.cc:407] Connection header received
0806 19:27:35.572790 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.572798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.573101 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.573334 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:35.574349 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.577797 (+ 3448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.580262 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.581812 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.581981 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.582187 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.582542 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.582739 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12487,"thread_start_us":12699,"threads_started":1}
I20260806 19:27:35.585063 18454 tablet_service.cc:1467] Processing CreateTablet for tablet b7d0660f693140e2bbada0c7f1c3c631 (DEFAULT_TABLE table=test-table [id=20cce543aafd41b0b776db6b509105b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:35.586957 18454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d0660f693140e2bbada0c7f1c3c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:35.587563 18634 tablet_service.cc:1467] Processing CreateTablet for tablet b7d0660f693140e2bbada0c7f1c3c631 (DEFAULT_TABLE table=test-table [id=20cce543aafd41b0b776db6b509105b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:35.589438 18634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d0660f693140e2bbada0c7f1c3c631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:35.600751 18941 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Bootstrap starting.
I20260806 19:27:35.601230 18939 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Bootstrap starting.
I20260806 19:27:35.604827 18939 tablet_bootstrap.cc:654] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:35.605049 18941 tablet_bootstrap.cc:654] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:35.606361 18939 log.cc:824] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:35.606566 18941 log.cc:824] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:35.608788 18942 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Bootstrap starting.
I20260806 19:27:35.609666 18939 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: No bootstrap required, opened a new log
I20260806 19:27:35.609956 18939 ts_tablet_manager.cc:1397] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260806 19:27:35.613695 18942 tablet_bootstrap.cc:654] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:35.615531 18942 log.cc:824] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:35.619827 18942 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: No bootstrap required, opened a new log
I20260806 19:27:35.619917 18941 tablet_bootstrap.cc:492] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: No bootstrap required, opened a new log
I20260806 19:27:35.620146 18942 ts_tablet_manager.cc:1397] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.008s
I20260806 19:27:35.620275 18941 ts_tablet_manager.cc:1397] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.006s
I20260806 19:27:35.621510 18939 raft_consensus.cc:348] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.622082 18939 raft_consensus.cc:374] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:35.622232 18939 raft_consensus.cc:729] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a729c1ea3eb4a5e9724d1f42a07da4a, State: Initialized, Role: FOLLOWER
I20260806 19:27:35.622963 18939 consensus_queue.cc:260] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.625146 18939 ts_tablet_manager.cc:1428] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260806 19:27:35.630923 18942 raft_consensus.cc:348] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.631441 18942 raft_consensus.cc:374] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:35.631537 18942 raft_consensus.cc:729] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 339b72a95b7c4cab8486111db14908f0, State: Initialized, Role: FOLLOWER
I20260806 19:27:35.631378 18941 raft_consensus.cc:348] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.632112 18941 raft_consensus.cc:374] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:35.632272 18941 raft_consensus.cc:729] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4edb3b0445f04a47b0515506bda8d3be, State: Initialized, Role: FOLLOWER
I20260806 19:27:35.632198 18942 consensus_queue.cc:260] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.633147 18941 consensus_queue.cc:260] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.635002 18722 heartbeater.cc:503] Master 127.17.18.126:45287 was elected leader, sending a full tablet report...
I20260806 19:27:35.635488 18942 ts_tablet_manager.cc:1428] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 19:27:35.639247 18908 heartbeater.cc:503] Master 127.17.18.126:45287 was elected leader, sending a full tablet report...
I20260806 19:27:35.640216 18941 ts_tablet_manager.cc:1428] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Time spent starting tablet: real 0.020s user 0.006s sys 0.012s
I20260806 19:27:35.671710 18949 raft_consensus.cc:482] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:35.672171 18949 raft_consensus.cc:504] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.674863 18949 leader_election.cc:288] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4edb3b0445f04a47b0515506bda8d3be (127.17.18.67:40909), 0a729c1ea3eb4a5e9724d1f42a07da4a (127.17.18.65:41279)
I20260806 19:27:35.686398 18931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.676094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35593 (local address 127.17.18.67:40909)
0806 19:27:35.676313 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.676320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.678657 (+ 2337us) server_negotiation.cc:407] Connection header received
0806 19:27:35.678846 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.678851 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.678941 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.679053 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:35.680149 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.681234 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.683926 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.685191 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.685358 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.685493 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.685874 (+ 381us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.686016 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:27:35.686592 18954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.675729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:40909 (local address 127.17.18.66:35593)
0806 19:27:35.678511 (+ 2782us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.678532 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.678701 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.679091 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.679095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.679120 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:35.679946 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.679957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.681438 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.681444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.683717 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.683733 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.685549 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.685561 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.685704 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.685731 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.685819 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.685976 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2590,"thread_start_us":1305,"threads_started":1}
I20260806 19:27:35.688335 18846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d0660f693140e2bbada0c7f1c3c631" candidate_uuid: "339b72a95b7c4cab8486111db14908f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4edb3b0445f04a47b0515506bda8d3be" is_pre_election: true
I20260806 19:27:35.689896 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.675638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:40553 (local address 127.17.18.65:41279)
0806 19:27:35.675994 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.676001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.677025 (+ 1024us) server_negotiation.cc:407] Connection header received
0806 19:27:35.677546 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.677553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.677643 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.677760 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:35.679360 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.680783 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.686662 (+ 5879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.688219 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.688423 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.688513 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.689363 (+ 850us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.689549 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204}
I20260806 19:27:35.689917 18951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.675136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41279 (local address 127.17.18.66:40553)
0806 19:27:35.676896 (+ 1760us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:35.676919 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:35.677296 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:35.677822 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:35.677826 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:35.677854 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:35.679206 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.679222 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.680958 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.680965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.686416 (+ 5451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:35.686432 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.688869 (+ 2437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.688878 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:35.689142 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.689193 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 19:27:35.689308 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 19:27:35.689505 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1480,"thread_start_us":1190,"threads_started":1}
I20260806 19:27:35.689697 18846 raft_consensus.cc:2454] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 339b72a95b7c4cab8486111db14908f0 in term 0.
I20260806 19:27:35.691139 18478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d0660f693140e2bbada0c7f1c3c631" candidate_uuid: "339b72a95b7c4cab8486111db14908f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" is_pre_election: true
I20260806 19:27:35.691620 18568 leader_election.cc:302] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 339b72a95b7c4cab8486111db14908f0, 4edb3b0445f04a47b0515506bda8d3be; no voters:
I20260806 19:27:35.691799 18478 raft_consensus.cc:2454] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 339b72a95b7c4cab8486111db14908f0 in term 0.
I20260806 19:27:35.692117 18949 raft_consensus.cc:2781] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:35.692366 18949 raft_consensus.cc:482] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:35.692575 18949 raft_consensus.cc:3037] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:35.695897 18949 raft_consensus.cc:504] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.696744 18949 leader_election.cc:288] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [CANDIDATE]: Term 1 election: Requested vote from peers 4edb3b0445f04a47b0515506bda8d3be (127.17.18.67:40909), 0a729c1ea3eb4a5e9724d1f42a07da4a (127.17.18.65:41279)
I20260806 19:27:35.697399 18846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d0660f693140e2bbada0c7f1c3c631" candidate_uuid: "339b72a95b7c4cab8486111db14908f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4edb3b0445f04a47b0515506bda8d3be"
I20260806 19:27:35.697431 18478 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d0660f693140e2bbada0c7f1c3c631" candidate_uuid: "339b72a95b7c4cab8486111db14908f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a"
I20260806 19:27:35.697683 18478 raft_consensus.cc:3037] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:35.697722 18846 raft_consensus.cc:3037] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 0 FOLLOWER]: Advancing to term 1
W20260806 19:27:35.701839 18911 tablet.cc:2369] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:27:35.702442 18846 raft_consensus.cc:2454] T b7d0660f693140e2bbada0c7f1c3c631 P 4edb3b0445f04a47b0515506bda8d3be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 339b72a95b7c4cab8486111db14908f0 in term 1.
I20260806 19:27:35.702441 18478 raft_consensus.cc:2454] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 339b72a95b7c4cab8486111db14908f0 in term 1.
I20260806 19:27:35.703045 18568 leader_election.cc:302] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 339b72a95b7c4cab8486111db14908f0, 4edb3b0445f04a47b0515506bda8d3be; no voters:
I20260806 19:27:35.703429 18949 raft_consensus.cc:2781] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:35.704242 18949 raft_consensus.cc:686] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [term 1 LEADER]: Becoming Leader. State: Replica: 339b72a95b7c4cab8486111db14908f0, State: Running, Role: LEADER
I20260806 19:27:35.704815 18949 consensus_queue.cc:237] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } }
I20260806 19:27:35.711366 18276 catalog_manager.cc:5495] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 339b72a95b7c4cab8486111db14908f0 (127.17.18.66). New cstate: current_term: 1 leader_uuid: "339b72a95b7c4cab8486111db14908f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4edb3b0445f04a47b0515506bda8d3be" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "339b72a95b7c4cab8486111db14908f0" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 35015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a729c1ea3eb4a5e9724d1f42a07da4a" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41279 } health_report { overall_health: UNKNOWN } } }
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:35.769559 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.749530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51112 (local address 127.17.18.65:41279)
0806 19:27:35.749750 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.749757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.750919 (+ 1162us) server_negotiation.cc:407] Connection header received
0806 19:27:35.751135 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.751145 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.751265 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.751386 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.753685 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.754538 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.756470 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.757063 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.757215 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.762660 (+ 5445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.762679 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.762700 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.762750 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.766184 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.767153 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.767162 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.767164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.767351 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.767788 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.767791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.767793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.768252 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.768529 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.768835 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.769023 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 19:27:35.799784 18542 tablet.cc:2369] T b7d0660f693140e2bbada0c7f1c3c631 P 0a729c1ea3eb4a5e9724d1f42a07da4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:35.829619 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.811552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.17.18.65:41279)
0806 19:27:35.811809 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.811817 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.812302 (+ 485us) server_negotiation.cc:407] Connection header received
0806 19:27:35.812480 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.812484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.812559 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.812647 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.814811 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.815812 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.817524 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.818025 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.818155 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.823203 (+ 5048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.823210 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.823214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.823263 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.826279 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.827226 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.827232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.827234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.827418 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.827989 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.827994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.827998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.828364 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.828633 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.829023 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.829287 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260806 19:27:35.847922 18723 tablet.cc:2369] T b7d0660f693140e2bbada0c7f1c3c631 P 339b72a95b7c4cab8486111db14908f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 19:27:35 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:35.894196 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.872952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.17.18.65:41279)
0806 19:27:35.873221 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.873226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.873451 (+ 225us) server_negotiation.cc:407] Connection header received
0806 19:27:35.873629 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.873727 (+ 98us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.873823 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.873937 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.875681 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.876486 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.877898 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.878369 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.878473 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.888074 (+ 9601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.888081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.888085 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.888132 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.890859 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.891734 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.891739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.891741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.891884 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.892417 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.892422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.892425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.892796 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.893025 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.893579 (+ 554us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.893836 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
W20260806 19:27:35.896690 18426 tablet_service.cc:2908] Rejecting scan request for tablet b7d0660f693140e2bbada0c7f1c3c631: Uninitialized: clean time has not yet been initialized
I20260806 19:27:35.901894 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18365
I20260806 19:27:35.916522 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:35.902881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.17.18.65:41279)
0806 19:27:35.903076 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:35.903081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:35.903363 (+ 282us) server_negotiation.cc:407] Connection header received
0806 19:27:35.903584 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:35.903588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:35.903673 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:35.903765 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:35.905283 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.906133 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.907652 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:35.908103 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:35.908229 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:35.910904 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:35.910912 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:35.910917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:35.910972 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:35.913699 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.914545 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.914550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.914552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.914700 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:35.915150 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:35.915154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:35.915156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:35.915505 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:35.915757 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:35.916057 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 19:27:35.916285 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:27:35.917222 18534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:36.009684 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18365
I20260806 19:27:36.038419 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18548
Aug 06 19:27:36 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:27:36.056808 18937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:36.039975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.17.18.66:35015)
0806 19:27:36.040214 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:36.040220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:36.040238 (+ 18us) server_negotiation.cc:407] Connection header received
0806 19:27:36.040295 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:36.040299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:36.040360 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:36.040458 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:36.041847 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:36.042612 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:36.043950 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:36.044425 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:36.044549 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:36.049441 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:36.049463 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:36.049484 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:36.049542 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:36.053088 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:36.054116 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:36.054126 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:36.054128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:36.054311 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:36.054849 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:36.054855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:36.054857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:36.055356 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:36.055621 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:36.056207 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 19:27:36.056510 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 19:27:36.057602 18714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:36.156129 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18548
I20260806 19:27:36.186944 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18728
Aug 06 19:27:36 dist-test-slave-f0tn krb5kdc[18218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:27:36.204224 18976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:36.187974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.17.18.67:40909)
0806 19:27:36.188504 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:36.188509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:36.188526 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:27:36.188588 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:36.188592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:36.188656 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:36.188761 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:36.190252 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:36.191012 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:36.192390 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:36.192813 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:36.192939 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:36.197571 (+ 4632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:36.197588 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:36.197607 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:36.197659 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:36.200430 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:36.201297 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:36.201306 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:36.201309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:36.201537 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:36.202332 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:36.202338 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:36.202340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:36.202799 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:36.203123 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:36.203458 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 19:27:36.203835 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":299,"threads_started":1}
I20260806 19:27:36.205093 18901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:36.299290 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18728
I20260806 19:27:36.322459 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18237
I20260806 19:27:36.323853 18324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:36.441056 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18237
2026-08-06T19:27:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4706 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:36 dist-test-slave-f0tn krb5kdc[18984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:36 dist-test-slave-f0tn krb5kdc[18984](info): set up 2 sockets
Aug 06 19:27:36 dist-test-slave-f0tn krb5kdc[18984](info): commencing operation
krb5kdc: starting...
W20260806 19:27:37.673764 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:37 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:37.897868 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34211
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:34211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:38.255101 19006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:38.255492 19006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:38.255653 19006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:38.264631 19006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:38.264822 19006 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 19:27:38.265221 19006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:38.265401 19006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:38.265573 19006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:38.265719 19006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:38.280306 19006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:34211
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:38.282006 19006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:38.283648 19006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:38.298894 19013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:38.298895 19014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:38.298951 19019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:38.310703 19006 server_base.cc:1034] running on GCE node
I20260806 19:27:38.311987 19006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:38.314505 19006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:38.315886 19006 hybrid_clock.cc:648] HybridClock initialized: now 1786044458315795 us; error 56 us; skew 500 ppm
I20260806 19:27:38.316613 19006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:38 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:38.320714 19006 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:38.322862 19006 webserver.cc:460] Webserver started at http://127.17.18.126:35181/ using document root <none> and password file <none>
I20260806 19:27:38.323784 19006 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:38.323911 19006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:38.324276 19006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:38.328707 19006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "6e23d67ea54b4ab98d9c248a0a136ed9"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "5b58ef9a3008db74f38dcb613001d816"
server_key_iv: "63de880ad8cc895f6461c8f25714a9a5"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.330372 19006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "6e23d67ea54b4ab98d9c248a0a136ed9"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "5b58ef9a3008db74f38dcb613001d816"
server_key_iv: "63de880ad8cc895f6461c8f25714a9a5"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.337920 19006 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260806 19:27:38.342986 19030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:38.345255 19006 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260806 19:27:38.345604 19006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "6e23d67ea54b4ab98d9c248a0a136ed9"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "5b58ef9a3008db74f38dcb613001d816"
server_key_iv: "63de880ad8cc895f6461c8f25714a9a5"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.345886 19006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:38.379276 19006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:38.384393 19006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:38.384703 19006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:38.409013 19006 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:34211
I20260806 19:27:38.409018 19117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:34211 every 8 connection(s)
I20260806 19:27:38.410629 19006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:38.412981 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 19006
I20260806 19:27:38.413290 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:38.414179 17481 external_mini_cluster.cc:1428] Setting key 7172c5b01a22f15ed9a7e14b1a2bf23c
I20260806 19:27:38.416054 19119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:27:38 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:38.431988 19119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Bootstrap starting.
I20260806 19:27:38.435715 19119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:38.436852 19119 log.cc:824] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:38.440547 19119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: No bootstrap required, opened a new log
I20260806 19:27:38.440577 19122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:38.416672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.17.18.126:34211)
0806 19:27:38.417694 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:38.417707 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:38.417757 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:27:38.419483 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:38.419520 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:38.419989 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:38.420372 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:38.422676 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:38.424290 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:38.426150 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:38.426922 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:38.427136 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:38.432491 (+ 5355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:38.432501 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:38.432521 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:38.432576 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:38.435773 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:38.436599 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:38.436607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:38.436614 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:38.436819 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:38.437274 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:38.437278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:38.437280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:38.438173 (+ 893us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:38.438486 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:38.439016 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 19:27:38.439464 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":390,"threads_started":1}
I20260806 19:27:38.449638 19119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } }
I20260806 19:27:38.450035 19119 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:38.450121 19119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e23d67ea54b4ab98d9c248a0a136ed9, State: Initialized, Role: FOLLOWER
I20260806 19:27:38.450663 19119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } }
I20260806 19:27:38.450899 19119 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:38.451028 19119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:38.451234 19119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:38.454030 19119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } }
I20260806 19:27:38.454600 19119 leader_election.cc:302] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e23d67ea54b4ab98d9c248a0a136ed9; no voters:
I20260806 19:27:38.455220 19119 leader_election.cc:288] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:38.455381 19126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:38.456372 19126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [term 1 LEADER]: Becoming Leader. State: Replica: 6e23d67ea54b4ab98d9c248a0a136ed9, State: Running, Role: LEADER
I20260806 19:27:38.456902 19126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } }
I20260806 19:27:38.457430 19119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:38.459918 19128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e23d67ea54b4ab98d9c248a0a136ed9. Latest consensus state: current_term: 1 leader_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } } }
I20260806 19:27:38.460335 19128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:38.460839 19127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e23d67ea54b4ab98d9c248a0a136ed9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34211 } } }
I20260806 19:27:38.461128 19127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:38.461350 19137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:38.468705 19137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:38.479117 19137 catalog_manager.cc:1347] Generated new cluster ID: 4de9f5dfbe034261a48dc84c24d357b1
I20260806 19:27:38.479262 19137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:38.489095 19137 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:38.490707 19137 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:38.499110 19137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Generated new TSK 0
I20260806 19:27:38.500128 19137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:38.567257 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34211
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:38.926365 19155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:38.926709 19155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:38.926848 19155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:38.934638 19155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:38.934792 19155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:38.934921 19155 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:38.935040 19155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:27:38.945611 19155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:34211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:38.947018 19155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:38.948473 19155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:38.963281 19161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:38.963342 19160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:38.963320 19163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:38.963771 19155 server_base.cc:1034] running on GCE node
I20260806 19:27:38.964676 19155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:38.965797 19155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:38.967118 19155 hybrid_clock.cc:648] HybridClock initialized: now 1786044458967024 us; error 55 us; skew 500 ppm
I20260806 19:27:38.967474 19155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:38 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:38.970978 19155 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:27:38.972651 19155 webserver.cc:460] Webserver started at http://127.17.18.65:37749/ using document root <none> and password file <none>
I20260806 19:27:38.973464 19155 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:38.973587 19155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:38.973930 19155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:38.977232 19155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "eb512203e9894ef083708b220f84437c"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "d17c3daf0a6939c64ccd5b0dd978ef39"
server_key_iv: "4964e3d8f2e3007e7abca1a52e8a07cc"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.978189 19155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "eb512203e9894ef083708b220f84437c"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "d17c3daf0a6939c64ccd5b0dd978ef39"
server_key_iv: "4964e3d8f2e3007e7abca1a52e8a07cc"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.983898 19155 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 19:27:38.987721 19173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:38.989224 19155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:27:38.989440 19155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "eb512203e9894ef083708b220f84437c"
format_stamp: "Formatted at 2026-08-06 19:27:38 on dist-test-slave-f0tn"
server_key: "d17c3daf0a6939c64ccd5b0dd978ef39"
server_key_iv: "4964e3d8f2e3007e7abca1a52e8a07cc"
server_key_version: "encryptionkey@0"
I20260806 19:27:38.989683 19155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:39.019968 19155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:39.025076 19155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:39.025434 19155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:39.028577 19155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:39.028679 19155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:39.028879 19155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:39.028942 19155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:39 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:39.055398 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.029490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:35013 (local address 127.17.18.126:34211)
0806 19:27:39.030004 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:39.030011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:39.031514 (+ 1503us) server_negotiation.cc:407] Connection header received
0806 19:27:39.034666 (+ 3152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:39.034673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:39.034771 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:39.034883 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:39.036906 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.038170 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.041750 (+ 3580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.042321 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.042498 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.047454 (+ 4956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:39.047460 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:39.047464 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:39.047514 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:39.051272 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.052356 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.052364 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.052368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.052564 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.053034 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.053040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.053043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.053466 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:39.053629 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:39.054746 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0806 19:27:39.055008 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":243,"threads_started":1}
I20260806 19:27:39.056959 19189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.030312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.65:35013)
0806 19:27:39.031285 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:39.031342 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:39.034171 (+ 2829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:39.035263 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:39.035275 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:39.035942 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:39.036677 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.036699 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.038417 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.038423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.041470 (+ 3047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.041502 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.042659 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.042668 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.043065 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.044192 (+ 1127us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:39.044220 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:39.047125 (+ 2905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:39.051492 (+ 4367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.051507 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.051532 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.052197 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.052690 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.052694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.052696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.052920 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.053631 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:39.053641 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:39.054216 (+ 575us) client_negotiation.cc:769] Sending connection context
0806 19:27:39.054590 (+ 374us) client_negotiation.cc:240] Negotiation successful
0806 19:27:39.055215 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":362,"threads_started":1}
I20260806 19:27:39.076408 19155 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:40645
I20260806 19:27:39.076444 19348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:40645 every 8 connection(s)
I20260806 19:27:39.078325 19155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:27:39.080776 19350 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34211
I20260806 19:27:39.081089 19350 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:39.081452 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 19155
I20260806 19:27:39.081725 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:27:39.082111 19350 heartbeater.cc:511] Master 127.17.18.126:34211 requested a full tablet report, sending...
I20260806 19:27:39.082476 19311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.066374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.65:55485)
0806 19:27:39.067117 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:39.067144 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:39.067346 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:39.067770 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:39.067774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:39.068287 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:39.068628 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.068639 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.070142 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.070147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.071996 (+ 1849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.072019 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.073177 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.073185 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.073423 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.074124 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:39.074155 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:39.075120 (+ 965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:39.079163 (+ 4043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.079169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.079173 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.079777 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.080311 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.080317 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.080320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.080497 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.081241 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:39.081246 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:39.081476 (+ 230us) client_negotiation.cc:769] Sending connection context
0806 19:27:39.081608 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 19:27:39.081967 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":390,"threads_started":1}
I20260806 19:27:39.082549 17481 external_mini_cluster.cc:1428] Setting key fb561785204313ec66e77127f352c513
I20260806 19:27:39.082989 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.066307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:55485 (local address 127.17.18.126:34211)
0806 19:27:39.066532 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:39.066539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:39.067268 (+ 729us) server_negotiation.cc:407] Connection header received
0806 19:27:39.067514 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:39.067520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:39.067617 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:39.067730 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:39.068825 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.069978 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.072241 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.072954 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.073110 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.075378 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:39.075385 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:39.075389 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:39.075435 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:39.078981 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.079966 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.079973 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.079977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.080180 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.080633 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.080639 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.080643 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.081093 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:39.082269 (+ 1176us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:39.082411 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 19:27:39.082669 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:27:39.085297 19050 ts_manager.cc:194] Registered new tserver with Master: eb512203e9894ef083708b220f84437c (127.17.18.65:40645)
I20260806 19:27:39.087348 19050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:35013
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:27:39.134473 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34211
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:39.479588 19354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:39.479907 19354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:39.480041 19354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:39.487567 19354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:39.487696 19354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:39.487823 19354 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:39.487916 19354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:27:39.498320 19354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:34211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:39.499704 19354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:39.501108 19354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:39.515043 19367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:39.515179 19365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:39.515383 19362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:39.516285 19354 server_base.cc:1034] running on GCE node
I20260806 19:27:39.516947 19354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:39.518025 19354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:39.519254 19354 hybrid_clock.cc:648] HybridClock initialized: now 1786044459519175 us; error 55 us; skew 500 ppm
I20260806 19:27:39.519567 19354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:39 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044459, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:39.526239 19354 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:27:39.527910 19354 webserver.cc:460] Webserver started at http://127.17.18.66:39547/ using document root <none> and password file <none>
I20260806 19:27:39.528666 19354 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:39.528764 19354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:39.529103 19354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:39.532420 19354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "d071e84da0894279a76ef1af565576bf"
format_stamp: "Formatted at 2026-08-06 19:27:39 on dist-test-slave-f0tn"
server_key: "c74ec90a682dc510534905b62c7e6d6d"
server_key_iv: "c09422fe8b7bdaa075abbf7076412e4c"
server_key_version: "encryptionkey@0"
I20260806 19:27:39.533310 19354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "d071e84da0894279a76ef1af565576bf"
format_stamp: "Formatted at 2026-08-06 19:27:39 on dist-test-slave-f0tn"
server_key: "c74ec90a682dc510534905b62c7e6d6d"
server_key_iv: "c09422fe8b7bdaa075abbf7076412e4c"
server_key_version: "encryptionkey@0"
I20260806 19:27:39.539086 19354 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 19:27:39.543045 19375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:39.544533 19354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:39.544757 19354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "d071e84da0894279a76ef1af565576bf"
format_stamp: "Formatted at 2026-08-06 19:27:39 on dist-test-slave-f0tn"
server_key: "c74ec90a682dc510534905b62c7e6d6d"
server_key_iv: "c09422fe8b7bdaa075abbf7076412e4c"
server_key_version: "encryptionkey@0"
I20260806 19:27:39.544993 19354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:39.563928 19354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:39.568506 19354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:39.568787 19354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:39.571771 19354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:39.571880 19354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:39.572048 19354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:39.572119 19354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:39 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044459, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:39.598521 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.572272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46795 (local address 127.17.18.126:34211)
0806 19:27:39.572492 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:39.572498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:39.574075 (+ 1577us) server_negotiation.cc:407] Connection header received
0806 19:27:39.576245 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:39.576253 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:39.576349 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:39.576465 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:39.578633 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.579635 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.583016 (+ 3381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.583759 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.583890 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.589964 (+ 6074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:39.589973 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:39.589979 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:39.590042 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:39.593966 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.595018 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.595025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.595030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.595230 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.595762 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.595768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.595771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.596179 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:39.596354 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:39.597199 (+ 845us) server_negotiation.cc:299] Negotiation successful
0806 19:27:39.597512 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:27:39.599433 19387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.572855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.66:46795)
0806 19:27:39.573841 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:39.573902 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:39.575896 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:39.576727 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:39.576736 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:39.577503 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:39.578420 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.578453 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.579861 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.579867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.582731 (+ 2864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.582759 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.584368 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.584378 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.584780 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.585777 (+ 997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:39.585822 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:39.589575 (+ 3753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:39.594184 (+ 4609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.594199 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.594221 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.594863 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.595366 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.595370 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.595373 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.595647 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.596357 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:39.596368 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:39.596793 (+ 425us) client_negotiation.cc:769] Sending connection context
0806 19:27:39.597054 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 19:27:39.597639 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":422,"threads_started":1}
I20260806 19:27:39.637109 19354 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:33647
I20260806 19:27:39.637123 19537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:33647 every 8 connection(s)
I20260806 19:27:39.638931 19188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.620655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:56393 (local address 127.17.18.126:34211)
0806 19:27:39.620827 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:39.620831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:39.621465 (+ 634us) server_negotiation.cc:407] Connection header received
0806 19:27:39.621735 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:39.621741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:39.621821 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:39.621917 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:39.623138 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.624385 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.626633 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.627319 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.627466 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.631571 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:39.631580 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:39.631585 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:39.631638 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:39.635232 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.636385 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.636392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.636395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.636555 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:39.637065 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:39.637071 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:39.637074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:39.637644 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:39.637836 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:39.638318 (+ 482us) server_negotiation.cc:299] Negotiation successful
0806 19:27:39.638573 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 19:27:39.638980 19354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:27:39.639041 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:39.620717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.66:56393)
0806 19:27:39.621341 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:39.621357 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:39.621575 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:39.621966 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:39.621970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:39.622541 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:39.622942 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.622957 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.624608 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.624615 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.626361 (+ 1746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:39.626378 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:39.627541 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:39.627550 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:39.627744 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:39.629966 (+ 2222us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:39.629996 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:39.631249 (+ 1253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:39.635464 (+ 4215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.635470 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.635474 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.636216 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.636699 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:39.636705 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:39.636708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:39.636899 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:39.637770 (+ 871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:39.637775 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:39.638015 (+ 240us) client_negotiation.cc:769] Sending connection context
0806 19:27:39.638165 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 19:27:39.638574 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":318,"threads_started":1}
I20260806 19:27:39.643574 19538 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34211
I20260806 19:27:39.643844 19538 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:39.644707 19538 heartbeater.cc:511] Master 127.17.18.126:34211 requested a full tablet report, sending...
I20260806 19:27:39.646333 19050 ts_manager.cc:194] Registered new tserver with Master: d071e84da0894279a76ef1af565576bf (127.17.18.66:33647)
I20260806 19:27:39.647308 19050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:46795
I20260806 19:27:39.648592 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 19354
I20260806 19:27:39.648833 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:27:39.649410 17481 external_mini_cluster.cc:1428] Setting key ed64e3204207ef3a79632f9c06544747
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:27:39.701799 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34211
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:40.050637 19545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:40.051003 19545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:40.051151 19545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:40.059563 19545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:40.059708 19545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:40.059798 19545 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:40.059880 19545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:27:40.070851 19545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:34211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:40.072302 19545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:40.073868 19545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 19:27:40.090512 19350 heartbeater.cc:503] Master 127.17.18.126:34211 was elected leader, sending a full tablet report...
W20260806 19:27:40.090440 19555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:40.090595 19553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:40.090445 19552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:40.092361 19545 server_base.cc:1034] running on GCE node
I20260806 19:27:40.093722 19545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:40.096063 19545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:40.097450 19545 hybrid_clock.cc:648] HybridClock initialized: now 1786044460097321 us; error 57 us; skew 500 ppm
I20260806 19:27:40.097857 19545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:40 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:40.102479 19545 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:27:40.104389 19545 webserver.cc:460] Webserver started at http://127.17.18.67:46631/ using document root <none> and password file <none>
I20260806 19:27:40.105510 19545 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:40.105656 19545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:40.106531 19545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:40.110387 19545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "b6655762bd554b8bb1154ba34d2feb52"
format_stamp: "Formatted at 2026-08-06 19:27:40 on dist-test-slave-f0tn"
server_key: "50d3f56675012ecef457150dd11a5c6d"
server_key_iv: "4648d9aa6ee49d1b98a1ed9f4d92b082"
server_key_version: "encryptionkey@0"
I20260806 19:27:40.111394 19545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "b6655762bd554b8bb1154ba34d2feb52"
format_stamp: "Formatted at 2026-08-06 19:27:40 on dist-test-slave-f0tn"
server_key: "50d3f56675012ecef457150dd11a5c6d"
server_key_iv: "4648d9aa6ee49d1b98a1ed9f4d92b082"
server_key_version: "encryptionkey@0"
I20260806 19:27:40.118781 19545 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260806 19:27:40.123565 19566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:40.125303 19545 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260806 19:27:40.125557 19545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "b6655762bd554b8bb1154ba34d2feb52"
format_stamp: "Formatted at 2026-08-06 19:27:40 on dist-test-slave-f0tn"
server_key: "50d3f56675012ecef457150dd11a5c6d"
server_key_iv: "4648d9aa6ee49d1b98a1ed9f4d92b082"
server_key_version: "encryptionkey@0"
I20260806 19:27:40.125818 19545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:40.161024 19545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:40.167356 19545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:40.167711 19545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:40.171368 19545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:40.171499 19545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:40.171654 19545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:40.171756 19545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:40 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:40.197285 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.171888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:39733 (local address 127.17.18.126:34211)
0806 19:27:40.172813 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.172817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.173836 (+ 1019us) server_negotiation.cc:407] Connection header received
0806 19:27:40.176053 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.176059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.176146 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.176266 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:40.179639 (+ 3373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.181094 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.183787 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.184521 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.184707 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.189831 (+ 5124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:40.189838 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:40.189841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:40.189885 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:40.193098 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.194327 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.194333 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.194335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.194547 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.195118 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.195121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.195123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.195472 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:40.195591 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.196752 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.196964 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":716,"threads_started":1}
I20260806 19:27:40.199687 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.172686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.67:39733)
0806 19:27:40.173658 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.173712 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.175692 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.176630 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.176650 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.177680 (+ 1030us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:40.179307 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.179352 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.181414 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.181424 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.183534 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.183557 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.184866 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.184876 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.185226 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.186140 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:40.186166 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:40.189514 (+ 3348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:40.193412 (+ 3898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:40.193424 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:40.193454 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:40.194162 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:40.194668 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:40.194673 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:40.194678 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:40.195004 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:40.195599 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:40.195609 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:40.196199 (+ 590us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.196593 (+ 394us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.197313 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":360,"threads_started":1}
I20260806 19:27:40.225461 19545 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:37419
I20260806 19:27:40.225524 19730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:37419 every 8 connection(s)
I20260806 19:27:40.227473 19545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:27:40.228987 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.207924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:34551 (local address 127.17.18.126:34211)
0806 19:27:40.208128 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.208136 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.208876 (+ 740us) server_negotiation.cc:407] Connection header received
0806 19:27:40.209232 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.209238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.209321 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.209420 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:40.211855 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.213425 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.215624 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.216645 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.216810 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.221525 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:40.221537 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:40.221544 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:40.221597 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:40.225519 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.226459 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.226464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.226467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.226642 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.227108 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.227112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.227114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.227473 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:40.227674 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.228167 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.228478 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:27:40.229219 19699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.207971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.17.18.67:34551)
0806 19:27:40.208743 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.208764 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.209033 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.209666 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.209671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.210314 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:40.211463 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.211484 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.213732 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.213738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.215433 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.215451 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.217078 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.217092 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.217347 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.218585 (+ 1238us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:40.218612 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:40.221104 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:40.225736 (+ 4632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:40.225746 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:40.225751 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:40.226311 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:40.226778 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:40.226783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:40.226785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:40.226982 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:40.227674 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:40.227679 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:40.227900 (+ 221us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.228031 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.228559 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":429,"threads_started":1}
I20260806 19:27:40.233050 19732 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34211
I20260806 19:27:40.233410 19732 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:40.235248 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 19545
I20260806 19:27:40.235468 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:27:40.234998 19732 heartbeater.cc:511] Master 127.17.18.126:34211 requested a full tablet report, sending...
I20260806 19:27:40.236101 17481 external_mini_cluster.cc:1428] Setting key 7af9df4c5f2b04e4de7d3f27fb307647
I20260806 19:27:40.237775 19052 ts_manager.cc:194] Registered new tserver with Master: b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419)
I20260806 19:27:40.239118 19052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:39733
I20260806 19:27:40.240067 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:27:40 dist-test-slave-f0tn krb5kdc[18984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260806 19:27:40.358299 17481 mini_kdc.cc:317] Time spent kinit for test-user: real 0.116s user 0.005s sys 0.016s
Aug 06 19:27:40 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:40.383901 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.364352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35664 (local address 127.17.18.126:34211)
0806 19:27:40.364621 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.364629 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.365128 (+ 499us) server_negotiation.cc:407] Connection header received
0806 19:27:40.365331 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.365335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.365485 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.365596 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:40.367943 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.368795 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.370434 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.371214 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.371341 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.376563 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:40.376570 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:40.376573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:40.376618 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:40.380329 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.381436 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.381443 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.381446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.381662 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:40.382195 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:40.382200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:40.382202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:40.382572 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:40.383009 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.383155 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.383348 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:27:40.389314 19052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:40.400045 19052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:40.440063 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.418895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.17.18.67:37419)
0806 19:27:40.420602 (+ 1707us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.420612 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.423755 (+ 3143us) server_negotiation.cc:407] Connection header received
0806 19:27:40.423938 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.423947 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.424235 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.424523 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:40.426944 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.429277 (+ 2333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.435700 (+ 6423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.437844 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.437968 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.438397 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.439400 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.439595 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1497,"thread_start_us":1093,"threads_started":1}
I20260806 19:27:40.440176 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.418012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37419 (local address 127.0.0.1:37212)
0806 19:27:40.423205 (+ 5193us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.423251 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.423499 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.425182 (+ 1683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.425189 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.425248 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:40.426602 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.426620 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.429579 (+ 2959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.429585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.435434 (+ 5849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.435449 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.438807 (+ 3358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.438817 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.439067 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.439118 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.439262 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.439515 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4837,"mutex_wait_us":18,"thread_start_us":5619,"threads_started":1}
I20260806 19:27:40.441957 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.417826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.17.18.66:33647)
0806 19:27:40.418727 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.418735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.425964 (+ 7229us) server_negotiation.cc:407] Connection header received
0806 19:27:40.426349 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.426359 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.426716 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.427010 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:40.431098 (+ 4088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.432915 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.438884 (+ 5969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.440625 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.440814 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.441086 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.441416 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.441611 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":603,"threads_started":1}
I20260806 19:27:40.442194 19749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.420640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33647 (local address 127.0.0.1:41512)
0806 19:27:40.425817 (+ 5177us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.425838 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.426113 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.428154 (+ 2041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.428160 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.428191 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:40.430719 (+ 2528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.430739 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.433115 (+ 2376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.433121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.438633 (+ 5512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.438646 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.440931 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.440941 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.441150 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.441192 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.441278 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.441449 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5006,"mutex_wait_us":19,"thread_start_us":10475,"threads_started":1}
I20260806 19:27:40.444635 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.422557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39158 (local address 127.17.18.65:40645)
0806 19:27:40.430899 (+ 8342us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.430910 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.432497 (+ 1587us) server_negotiation.cc:407] Connection header received
0806 19:27:40.432651 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.432659 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.433004 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.433260 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:40.435109 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.437221 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.441016 (+ 3795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.443088 (+ 2072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.443277 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.443512 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.444000 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.444264 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8158,"thread_start_us":7939,"threads_started":1}
I20260806 19:27:40.444706 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.421855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40645 (local address 127.0.0.1:39158)
0806 19:27:40.432132 (+ 10277us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.432157 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.432338 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.433431 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.433436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.433475 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:40.434752 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.434769 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.437484 (+ 2715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.437489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.440742 (+ 3253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.440760 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.443390 (+ 2630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.443397 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.443626 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.443653 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.443923 (+ 270us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.444077 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10086,"thread_start_us":792,"threads_started":1}
I20260806 19:27:40.447271 19443 tablet_service.cc:1467] Processing CreateTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a (DEFAULT_TABLE table=test-table [id=21d6ef47403b41369a0254417547da7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.447765 19639 tablet_service.cc:1467] Processing CreateTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a (DEFAULT_TABLE table=test-table [id=21d6ef47403b41369a0254417547da7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.449275 19443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f51f32c3d3a4966ace5884af7f9424a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.449887 19639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f51f32c3d3a4966ace5884af7f9424a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.450883 19254 tablet_service.cc:1467] Processing CreateTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a (DEFAULT_TABLE table=test-table [id=21d6ef47403b41369a0254417547da7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.452483 19254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f51f32c3d3a4966ace5884af7f9424a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.470163 19758 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Bootstrap starting.
I20260806 19:27:40.474808 19760 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Bootstrap starting.
I20260806 19:27:40.476971 19758 tablet_bootstrap.cc:654] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.477885 19761 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Bootstrap starting.
I20260806 19:27:40.479786 19758 log.cc:824] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:40.481173 19760 tablet_bootstrap.cc:654] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.483361 19760 log.cc:824] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:40.484009 19761 tablet_bootstrap.cc:654] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.485360 19758 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: No bootstrap required, opened a new log
I20260806 19:27:40.485847 19758 ts_tablet_manager.cc:1397] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260806 19:27:40.486848 19761 log.cc:824] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:40.487718 19760 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: No bootstrap required, opened a new log
I20260806 19:27:40.488216 19760 ts_tablet_manager.cc:1397] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260806 19:27:40.491833 19761 tablet_bootstrap.cc:492] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: No bootstrap required, opened a new log
I20260806 19:27:40.492254 19761 ts_tablet_manager.cc:1397] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20260806 19:27:40.498488 19758 raft_consensus.cc:348] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.499145 19758 raft_consensus.cc:374] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.499380 19758 raft_consensus.cc:729] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb512203e9894ef083708b220f84437c, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.500428 19758 consensus_queue.cc:260] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.503321 19758 ts_tablet_manager.cc:1428] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260806 19:27:40.504364 19760 raft_consensus.cc:348] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.504976 19760 raft_consensus.cc:374] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.505307 19760 raft_consensus.cc:729] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6655762bd554b8bb1154ba34d2feb52, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.506240 19760 consensus_queue.cc:260] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.508344 19761 raft_consensus.cc:348] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.508872 19732 heartbeater.cc:503] Master 127.17.18.126:34211 was elected leader, sending a full tablet report...
I20260806 19:27:40.508978 19761 raft_consensus.cc:374] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.509114 19761 raft_consensus.cc:729] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d071e84da0894279a76ef1af565576bf, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.510150 19761 consensus_queue.cc:260] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.511970 19760 ts_tablet_manager.cc:1428] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Time spent starting tablet: real 0.024s user 0.013s sys 0.010s
I20260806 19:27:40.513727 19538 heartbeater.cc:503] Master 127.17.18.126:34211 was elected leader, sending a full tablet report...
I20260806 19:27:40.514688 19761 ts_tablet_manager.cc:1428] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Time spent starting tablet: real 0.022s user 0.023s sys 0.000s
I20260806 19:27:40.519295 19771 raft_consensus.cc:482] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:40.519650 19771 raft_consensus.cc:504] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.522408 19771 leader_election.cc:288] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419), eb512203e9894ef083708b220f84437c (127.17.18.65:40645)
I20260806 19:27:40.533638 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.522331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:58533 (local address 127.17.18.65:40645)
0806 19:27:40.522646 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.522651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.524784 (+ 2133us) server_negotiation.cc:407] Connection header received
0806 19:27:40.524997 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.525002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.525119 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.525287 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:40.526918 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.527835 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.531204 (+ 3369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.532407 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.532613 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.532696 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.533163 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.533314 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260806 19:27:40.533984 19772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.522399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40645 (local address 127.17.18.66:58533)
0806 19:27:40.524637 (+ 2238us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.524670 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.524855 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.525293 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.525297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.525325 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:40.526700 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.526710 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.527983 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.527989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.530959 (+ 2970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.530978 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.532804 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.532812 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.532970 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.532999 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.533101 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.533228 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2060,"mutex_wait_us":21,"thread_start_us":1596,"threads_started":1}
I20260806 19:27:40.534626 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.523028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:41357 (local address 127.17.18.67:37419)
0806 19:27:40.523240 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.523245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.525046 (+ 1801us) server_negotiation.cc:407] Connection header received
0806 19:27:40.525171 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.525176 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.525248 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.525335 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:40.527539 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.528833 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.532228 (+ 3395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.533412 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.533618 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.533696 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.534150 (+ 454us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.534297 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:27:40.534795 19774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.523331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37419 (local address 127.17.18.66:41357)
0806 19:27:40.524938 (+ 1607us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:40.524954 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:40.525074 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:40.525346 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:40.525350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:40.525367 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:40.526680 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.526700 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.529088 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.529094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.532022 (+ 2928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:40.532038 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.533716 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.533724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:40.533954 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.533994 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 19:27:40.534101 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 19:27:40.534254 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1472,"mutex_wait_us":26,"thread_start_us":1132,"threads_started":1}
I20260806 19:27:40.535499 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f51f32c3d3a4966ace5884af7f9424a" candidate_uuid: "d071e84da0894279a76ef1af565576bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb512203e9894ef083708b220f84437c" is_pre_election: true
I20260806 19:27:40.536046 19278 raft_consensus.cc:2454] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d071e84da0894279a76ef1af565576bf in term 0.
I20260806 19:27:40.535951 19668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f51f32c3d3a4966ace5884af7f9424a" candidate_uuid: "d071e84da0894279a76ef1af565576bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6655762bd554b8bb1154ba34d2feb52" is_pre_election: true
I20260806 19:27:40.536420 19668 raft_consensus.cc:2454] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d071e84da0894279a76ef1af565576bf in term 0.
I20260806 19:27:40.536762 19376 leader_election.cc:302] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d071e84da0894279a76ef1af565576bf, eb512203e9894ef083708b220f84437c; no voters:
I20260806 19:27:40.537268 19771 raft_consensus.cc:2781] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:40.537489 19771 raft_consensus.cc:482] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:40.537604 19771 raft_consensus.cc:3037] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:40.568915 19771 raft_consensus.cc:504] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.570062 19771 leader_election.cc:288] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [CANDIDATE]: Term 1 election: Requested vote from peers b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419), eb512203e9894ef083708b220f84437c (127.17.18.65:40645)
I20260806 19:27:40.570808 19668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f51f32c3d3a4966ace5884af7f9424a" candidate_uuid: "d071e84da0894279a76ef1af565576bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6655762bd554b8bb1154ba34d2feb52"
I20260806 19:27:40.570808 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f51f32c3d3a4966ace5884af7f9424a" candidate_uuid: "d071e84da0894279a76ef1af565576bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb512203e9894ef083708b220f84437c"
I20260806 19:27:40.571089 19278 raft_consensus.cc:3037] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:40.571089 19668 raft_consensus.cc:3037] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Advancing to term 1
W20260806 19:27:40.582199 19351 tablet.cc:2369] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:27:40.642998 19541 tablet.cc:2369] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:27:40.666049 19278 raft_consensus.cc:2454] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d071e84da0894279a76ef1af565576bf in term 1.
I20260806 19:27:40.666087 19668 raft_consensus.cc:2454] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d071e84da0894279a76ef1af565576bf in term 1.
I20260806 19:27:40.666805 19376 leader_election.cc:302] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d071e84da0894279a76ef1af565576bf, eb512203e9894ef083708b220f84437c; no voters:
I20260806 19:27:40.667234 19771 raft_consensus.cc:2781] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:40.667927 19771 raft_consensus.cc:686] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 1 LEADER]: Becoming Leader. State: Replica: d071e84da0894279a76ef1af565576bf, State: Running, Role: LEADER
I20260806 19:27:40.668653 19771 consensus_queue.cc:237] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } }
I20260806 19:27:40.675119 19050 catalog_manager.cc:5495] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf reported cstate change: term changed from 0 to 1, leader changed from <none> to d071e84da0894279a76ef1af565576bf (127.17.18.66). New cstate: current_term: 1 leader_uuid: "d071e84da0894279a76ef1af565576bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } health_report { overall_health: UNKNOWN } } }
W20260806 19:27:40.736313 19733 tablet.cc:2369] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:27:40.754385 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:40.747748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.17.18.66:33647)
0806 19:27:40.747936 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:40.747940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:40.747961 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:27:40.748380 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:40.748384 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:40.748489 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:40.748637 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:40.749182 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.750052 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.751713 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:40.752165 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:40.752279 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:40.752888 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:40.753674 (+ 786us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:40.753801 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:40.754053 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 19:27:40.754150 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:27:40.765650 19278 raft_consensus.cc:1261] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Refusing update from remote peer d071e84da0894279a76ef1af565576bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:40.767179 19668 raft_consensus.cc:1261] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Refusing update from remote peer d071e84da0894279a76ef1af565576bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:40.767092 19775 consensus_queue.cc:1035] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:40.768189 19775 consensus_queue.cc:1035] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:40.780179 19779 mvcc.cc:205] Tried to move back new op lower bound from 7315638111279837184 to 7315638110904258560. Current Snapshot: MvccSnapshot[applied={T|T < 7315638111279837184}]
I20260806 19:27:40.807948 19050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:40.808415 19050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:40.813673 19050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Sending DeleteTablet for 3 replicas of tablet 6f51f32c3d3a4966ace5884af7f9424a
I20260806 19:27:40.815655 19443 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:40 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:41512
I20260806 19:27:40.815727 19254 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:40 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39158
I20260806 19:27:40.815655 19639 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f51f32c3d3a4966ace5884af7f9424a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:40 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:37212
I20260806 19:27:40.821961 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:40.822844 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:40.831049 19798 tablet_replica.cc:330] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: stopping tablet replica
I20260806 19:27:40.831068 19800 tablet_replica.cc:330] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: stopping tablet replica
I20260806 19:27:40.831844 19798 raft_consensus.cc:2229] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:40.831873 19800 raft_consensus.cc:2229] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:40.832441 19798 raft_consensus.cc:2258] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:40.832657 19800 raft_consensus.cc:2258] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:40.833894 19639 tablet_service.cc:1467] Processing CreateTablet for tablet 4a30ee87416643c9a98c3822b417ce0d (DEFAULT_TABLE table=test-table [id=082e5d85fc814b808d741312feaf4ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.834307 19442 tablet_service.cc:1467] Processing CreateTablet for tablet 4a30ee87416643c9a98c3822b417ce0d (DEFAULT_TABLE table=test-table [id=082e5d85fc814b808d741312feaf4ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.834473 19639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a30ee87416643c9a98c3822b417ce0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.834942 19442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a30ee87416643c9a98c3822b417ce0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.835628 19798 ts_tablet_manager.cc:1905] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:40.841842 19760 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Bootstrap starting.
I20260806 19:27:40.843230 19761 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Bootstrap starting.
I20260806 19:27:40.843111 19254 tablet_service.cc:1467] Processing CreateTablet for tablet 4a30ee87416643c9a98c3822b417ce0d (DEFAULT_TABLE table=test-table [id=082e5d85fc814b808d741312feaf4ac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:40.843791 19760 tablet_bootstrap.cc:654] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.845023 19761 tablet_bootstrap.cc:654] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.846376 19800 ts_tablet_manager.cc:1905] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:40.848953 19760 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: No bootstrap required, opened a new log
I20260806 19:27:40.849421 19760 ts_tablet_manager.cc:1397] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260806 19:27:40.851068 19760 raft_consensus.cc:348] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.851639 19760 raft_consensus.cc:374] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.851949 19760 raft_consensus.cc:729] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6655762bd554b8bb1154ba34d2feb52, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.852526 19760 consensus_queue.cc:260] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.855610 19760 ts_tablet_manager.cc:1428] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260806 19:27:40.857296 19796 tablet_replica.cc:330] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: stopping tablet replica
I20260806 19:27:40.858014 19796 raft_consensus.cc:2229] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:40.859349 19796 raft_consensus.cc:2258] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:40.861351 19761 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: No bootstrap required, opened a new log
I20260806 19:27:40.861692 19761 ts_tablet_manager.cc:1397] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260806 19:27:40.862424 19796 ts_tablet_manager.cc:1905] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:40.863265 19761 raft_consensus.cc:348] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.863710 19761 raft_consensus.cc:374] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.863956 19761 raft_consensus.cc:729] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d071e84da0894279a76ef1af565576bf, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.864383 19761 consensus_queue.cc:260] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.865964 19761 ts_tablet_manager.cc:1428] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260806 19:27:40.870695 19254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a30ee87416643c9a98c3822b417ce0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:40.875881 19798 ts_tablet_manager.cc:1918] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:27:40.876313 19798 log.cc:1196] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/6f51f32c3d3a4966ace5884af7f9424a
I20260806 19:27:40.877310 19798 ts_tablet_manager.cc:1939] T 6f51f32c3d3a4966ace5884af7f9424a P eb512203e9894ef083708b220f84437c: Deleting consensus metadata
I20260806 19:27:40.879199 19800 ts_tablet_manager.cc:1918] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:27:40.879595 19800 log.cc:1196] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/6f51f32c3d3a4966ace5884af7f9424a
I20260806 19:27:40.881021 19758 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Bootstrap starting.
I20260806 19:27:40.881219 19800 ts_tablet_manager.cc:1939] T 6f51f32c3d3a4966ace5884af7f9424a P b6655762bd554b8bb1154ba34d2feb52: Deleting consensus metadata
I20260806 19:27:40.883037 19758 tablet_bootstrap.cc:654] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:40.887917 19758 tablet_bootstrap.cc:492] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: No bootstrap required, opened a new log
I20260806 19:27:40.888183 19758 ts_tablet_manager.cc:1397] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 19:27:40.889293 19758 raft_consensus.cc:348] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.889603 19758 raft_consensus.cc:374] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:40.889904 19758 raft_consensus.cc:729] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb512203e9894ef083708b220f84437c, State: Initialized, Role: FOLLOWER
I20260806 19:27:40.890338 19758 consensus_queue.cc:260] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:40.891085 19758 ts_tablet_manager.cc:1428] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:40.946249 19032 catalog_manager.cc:4841] TS eb512203e9894ef083708b220f84437c (127.17.18.65:40645): tablet 6f51f32c3d3a4966ace5884af7f9424a (table test-table [id=21d6ef47403b41369a0254417547da7d]) successfully deleted
I20260806 19:27:40.946738 19035 catalog_manager.cc:4841] TS b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419): tablet 6f51f32c3d3a4966ace5884af7f9424a (table test-table [id=21d6ef47403b41369a0254417547da7d]) successfully deleted
I20260806 19:27:40.971081 19796 ts_tablet_manager.cc:1918] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:27:40.971469 19796 log.cc:1196] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/6f51f32c3d3a4966ace5884af7f9424a
I20260806 19:27:40.972427 19796 ts_tablet_manager.cc:1939] T 6f51f32c3d3a4966ace5884af7f9424a P d071e84da0894279a76ef1af565576bf: Deleting consensus metadata
I20260806 19:27:40.975589 19034 catalog_manager.cc:4841] TS d071e84da0894279a76ef1af565576bf (127.17.18.66:33647): tablet 6f51f32c3d3a4966ace5884af7f9424a (table test-table [id=21d6ef47403b41369a0254417547da7d]) successfully deleted
I20260806 19:27:41.029690 19768 raft_consensus.cc:482] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:41.030158 19768 raft_consensus.cc:504] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.032913 19768 leader_election.cc:288] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb512203e9894ef083708b220f84437c (127.17.18.65:40645), d071e84da0894279a76ef1af565576bf (127.17.18.66:33647)
I20260806 19:27:41.045343 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.033094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33647 (local address 127.17.18.67:40267)
0806 19:27:41.034424 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.034445 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.034727 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.035691 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.035697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.035731 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:41.035989 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.036001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.038157 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.038162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.041987 (+ 3825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.042026 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.044319 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.044325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.044554 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.044593 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.044697 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.044844 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":838,"threads_started":1}
I20260806 19:27:41.045408 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.034055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:40267 (local address 127.17.18.66:33647)
0806 19:27:41.034379 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.034386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.034535 (+ 149us) server_negotiation.cc:407] Connection header received
0806 19:27:41.034941 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.034948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.035057 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.035122 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:41.036178 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.037875 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.042224 (+ 4349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.044116 (+ 1892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.044339 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.044447 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.044749 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.044955 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260806 19:27:41.046911 19472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a30ee87416643c9a98c3822b417ce0d" candidate_uuid: "b6655762bd554b8bb1154ba34d2feb52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d071e84da0894279a76ef1af565576bf" is_pre_election: true
I20260806 19:27:41.047585 19472 raft_consensus.cc:2454] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6655762bd554b8bb1154ba34d2feb52 in term 0.
I20260806 19:27:41.048676 19569 leader_election.cc:302] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6655762bd554b8bb1154ba34d2feb52, d071e84da0894279a76ef1af565576bf; no voters:
I20260806 19:27:41.049230 19768 raft_consensus.cc:2781] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:41.049355 19768 raft_consensus.cc:482] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:41.049502 19768 raft_consensus.cc:3037] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.052523 19809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.034859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40645 (local address 127.17.18.67:48511)
0806 19:27:41.042168 (+ 7309us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.042188 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.042361 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.042681 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.042685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.042712 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:41.043344 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.043357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.045267 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.045272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.048233 (+ 2961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.048254 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.051162 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.051174 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.051569 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.051617 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.051750 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.051913 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7100,"thread_start_us":6800,"threads_started":1}
I20260806 19:27:41.052627 19807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.034535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:48511 (local address 127.17.18.65:40645)
0806 19:27:41.041985 (+ 7450us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.041992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.042271 (+ 279us) server_negotiation.cc:407] Connection header received
0806 19:27:41.042494 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.042499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.042561 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.042642 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:41.043605 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.045031 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.048471 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.050677 (+ 2206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.051013 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.051102 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.051792 (+ 690us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.052001 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6740,"thread_start_us":6608,"threads_started":1}
I20260806 19:27:41.054050 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a30ee87416643c9a98c3822b417ce0d" candidate_uuid: "b6655762bd554b8bb1154ba34d2feb52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb512203e9894ef083708b220f84437c" is_pre_election: true
I20260806 19:27:41.054363 19278 raft_consensus.cc:2454] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6655762bd554b8bb1154ba34d2feb52 in term 0.
I20260806 19:27:41.073900 19768 raft_consensus.cc:504] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.075098 19768 leader_election.cc:288] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [CANDIDATE]: Term 1 election: Requested vote from peers eb512203e9894ef083708b220f84437c (127.17.18.65:40645), d071e84da0894279a76ef1af565576bf (127.17.18.66:33647)
I20260806 19:27:41.076210 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a30ee87416643c9a98c3822b417ce0d" candidate_uuid: "b6655762bd554b8bb1154ba34d2feb52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb512203e9894ef083708b220f84437c"
I20260806 19:27:41.076609 19278 raft_consensus.cc:3037] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.078933 19472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a30ee87416643c9a98c3822b417ce0d" candidate_uuid: "b6655762bd554b8bb1154ba34d2feb52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d071e84da0894279a76ef1af565576bf"
I20260806 19:27:41.079260 19472 raft_consensus.cc:3037] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.170245 19278 raft_consensus.cc:2454] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6655762bd554b8bb1154ba34d2feb52 in term 1.
I20260806 19:27:41.170387 19472 raft_consensus.cc:2454] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6655762bd554b8bb1154ba34d2feb52 in term 1.
I20260806 19:27:41.171178 19569 leader_election.cc:302] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6655762bd554b8bb1154ba34d2feb52, d071e84da0894279a76ef1af565576bf; no voters:
I20260806 19:27:41.171736 19768 raft_consensus.cc:2781] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:41.172744 19768 raft_consensus.cc:686] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 1 LEADER]: Becoming Leader. State: Replica: b6655762bd554b8bb1154ba34d2feb52, State: Running, Role: LEADER
I20260806 19:27:41.173524 19768 consensus_queue.cc:237] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.179699 19050 catalog_manager.cc:5495] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67). New cstate: current_term: 1 leader_uuid: "b6655762bd554b8bb1154ba34d2feb52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } health_report { overall_health: HEALTHY } } }
Aug 06 19:27:41 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044458, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:41.300438 19819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.273033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34211 (local address 127.0.0.1:35670)
0806 19:27:41.275387 (+ 2354us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.275418 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.275674 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.276294 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.276300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.277996 (+ 1696us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:41.278532 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.278551 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.280067 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.280073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.281644 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.281661 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.282480 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.282493 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.282675 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.287551 (+ 4876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:41.287666 (+ 115us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:41.291794 (+ 4128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:41.296314 (+ 4520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:41.296335 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:41.296345 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:41.297159 (+ 814us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:41.297700 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:41.297705 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:41.297709 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:41.297997 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:41.298712 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:41.298722 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:41.298991 (+ 269us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.299206 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.299571 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2068,"thread_start_us":1714,"threads_started":1}
I20260806 19:27:41.300498 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.273012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.17.18.126:34211)
0806 19:27:41.274056 (+ 1044us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.274062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.275562 (+ 1500us) server_negotiation.cc:407] Connection header received
0806 19:27:41.275946 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.275952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.276031 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.276163 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:41.278756 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.279866 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.281821 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.282280 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.282386 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.292127 (+ 9741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:41.292134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:41.292138 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:41.292177 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:41.296142 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.297315 (+ 1173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.297321 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.297324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.297578 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.298135 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.298139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.298141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.298569 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:41.298732 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.299338 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.299750 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":174,"server-negotiator.queue_time_us":807,"thread_start_us":464,"threads_started":1}
I20260806 19:27:41.309043 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:35670:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 19:27:41.310827 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:41.319665 19254 tablet_service.cc:1467] Processing CreateTablet for tablet a731001202174f1d8f070b75e6e0d48d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=855b59bd26ab4682a436ed1d538c9ea5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:41.320142 19443 tablet_service.cc:1467] Processing CreateTablet for tablet a731001202174f1d8f070b75e6e0d48d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=855b59bd26ab4682a436ed1d538c9ea5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:41.320637 19254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a731001202174f1d8f070b75e6e0d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:41.320494 19639 tablet_service.cc:1467] Processing CreateTablet for tablet a731001202174f1d8f070b75e6e0d48d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=855b59bd26ab4682a436ed1d538c9ea5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:41.320829 19443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a731001202174f1d8f070b75e6e0d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:41.321127 19639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a731001202174f1d8f070b75e6e0d48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:41.331813 19758 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: Bootstrap starting.
I20260806 19:27:41.332471 19760 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: Bootstrap starting.
I20260806 19:27:41.334120 19761 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: Bootstrap starting.
I20260806 19:27:41.336371 19760 tablet_bootstrap.cc:654] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:41.336385 19758 tablet_bootstrap.cc:654] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:41.337512 19761 tablet_bootstrap.cc:654] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:41.341912 19760 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: No bootstrap required, opened a new log
I20260806 19:27:41.342247 19760 ts_tablet_manager.cc:1397] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260806 19:27:41.342329 19761 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: No bootstrap required, opened a new log
I20260806 19:27:41.342612 19761 ts_tablet_manager.cc:1397] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260806 19:27:41.343851 19760 raft_consensus.cc:348] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.343878 19761 raft_consensus.cc:348] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.344291 19760 raft_consensus.cc:374] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:41.344329 19761 raft_consensus.cc:374] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:41.344472 19760 raft_consensus.cc:729] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6655762bd554b8bb1154ba34d2feb52, State: Initialized, Role: FOLLOWER
I20260806 19:27:41.344513 19761 raft_consensus.cc:729] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d071e84da0894279a76ef1af565576bf, State: Initialized, Role: FOLLOWER
I20260806 19:27:41.344983 19760 consensus_queue.cc:260] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.344939 19761 consensus_queue.cc:260] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.345830 19758 tablet_bootstrap.cc:492] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: No bootstrap required, opened a new log
I20260806 19:27:41.345675 19775 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.346113 19775 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.347306 19758 ts_tablet_manager.cc:1397] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.010s
I20260806 19:27:41.347940 19768 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.348317 19768 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.348803 19758 raft_consensus.cc:348] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.349073 19758 raft_consensus.cc:374] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:41.349174 19758 raft_consensus.cc:729] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb512203e9894ef083708b220f84437c, State: Initialized, Role: FOLLOWER
I20260806 19:27:41.349735 19760 ts_tablet_manager.cc:1428] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260806 19:27:41.349761 19758 consensus_queue.cc:260] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.350142 19767 raft_consensus.cc:482] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:41.350390 19767 raft_consensus.cc:504] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.351713 19761 ts_tablet_manager.cc:1428] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: Time spent starting tablet: real 0.009s user 0.003s sys 0.001s
I20260806 19:27:41.352988 19767 leader_election.cc:288] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d071e84da0894279a76ef1af565576bf (127.17.18.66:33647), b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419)
I20260806 19:27:41.357806 19767 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.358384 19767 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.358983 19758 ts_tablet_manager.cc:1428] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20260806 19:27:41.374104 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.354138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:37243 (local address 127.17.18.67:37419)
0806 19:27:41.363680 (+ 9542us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.363686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.363926 (+ 240us) server_negotiation.cc:407] Connection header received
0806 19:27:41.364262 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.364268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.364344 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.364431 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:41.365476 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.367299 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.370954 (+ 3655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.372270 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.372455 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.372543 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.373495 (+ 952us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.373676 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9347,"thread_start_us":11308,"threads_started":1}
I20260806 19:27:41.374684 19831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.354191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37419 (local address 127.17.18.65:37243)
0806 19:27:41.363828 (+ 9637us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.363844 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.363996 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.364471 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.364475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.364500 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:41.365231 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.365245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.367494 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.367500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.370703 (+ 3203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.370724 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.372535 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.372543 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.372736 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.372774 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.372879 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.373044 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8891,"thread_start_us":8496,"threads_started":1}
I20260806 19:27:41.377240 19748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.353600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:49605 (local address 127.17.18.66:33647)
0806 19:27:41.353885 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.353893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.362576 (+ 8683us) server_negotiation.cc:407] Connection header received
0806 19:27:41.364513 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.364519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.364605 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.364719 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:41.366206 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.367801 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.373358 (+ 5557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.375224 (+ 1866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.375429 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.375502 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.376581 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.376808 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:27:41.378217 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.353075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33647 (local address 127.17.18.65:49605)
0806 19:27:41.362449 (+ 9374us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.362473 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.364323 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.364926 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.364931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.364958 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:41.365943 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.365960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.368021 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.368027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.373070 (+ 5043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.373085 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.376111 (+ 3026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.376121 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.376360 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.376397 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.377616 (+ 1219us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.377755 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9059,"mutex_wait_us":1,"thread_start_us":5255,"threads_started":1}
I20260806 19:27:41.379019 19472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a731001202174f1d8f070b75e6e0d48d" candidate_uuid: "eb512203e9894ef083708b220f84437c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d071e84da0894279a76ef1af565576bf" is_pre_election: true
I20260806 19:27:41.379567 19472 raft_consensus.cc:2454] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb512203e9894ef083708b220f84437c in term 0.
I20260806 19:27:41.380313 19178 leader_election.cc:302] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d071e84da0894279a76ef1af565576bf, eb512203e9894ef083708b220f84437c; no voters:
I20260806 19:27:41.380849 19767 raft_consensus.cc:2781] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:41.380980 19767 raft_consensus.cc:482] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:41.381069 19767 raft_consensus.cc:3037] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.381006 19668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a731001202174f1d8f070b75e6e0d48d" candidate_uuid: "eb512203e9894ef083708b220f84437c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6655762bd554b8bb1154ba34d2feb52" is_pre_election: true
I20260806 19:27:41.381278 19668 raft_consensus.cc:2454] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb512203e9894ef083708b220f84437c in term 0.
I20260806 19:27:41.478791 19767 raft_consensus.cc:504] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.479668 19767 leader_election.cc:288] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [CANDIDATE]: Term 1 election: Requested vote from peers d071e84da0894279a76ef1af565576bf (127.17.18.66:33647), b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419)
I20260806 19:27:41.480459 19668 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a731001202174f1d8f070b75e6e0d48d" candidate_uuid: "eb512203e9894ef083708b220f84437c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6655762bd554b8bb1154ba34d2feb52"
I20260806 19:27:41.480567 19472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a731001202174f1d8f070b75e6e0d48d" candidate_uuid: "eb512203e9894ef083708b220f84437c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d071e84da0894279a76ef1af565576bf"
I20260806 19:27:41.480690 19668 raft_consensus.cc:3037] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.481087 19472 raft_consensus.cc:3037] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:41.565083 19768 consensus_queue.cc:1035] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:41.573596 19768 consensus_queue.cc:1035] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:41.579586 19668 raft_consensus.cc:2454] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb512203e9894ef083708b220f84437c in term 1.
I20260806 19:27:41.579555 19472 raft_consensus.cc:2454] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb512203e9894ef083708b220f84437c in term 1.
I20260806 19:27:41.580108 19178 leader_election.cc:302] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d071e84da0894279a76ef1af565576bf, eb512203e9894ef083708b220f84437c; no voters:
I20260806 19:27:41.580504 19767 raft_consensus.cc:2781] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:41.585353 19767 raft_consensus.cc:686] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [term 1 LEADER]: Becoming Leader. State: Replica: eb512203e9894ef083708b220f84437c, State: Running, Role: LEADER
I20260806 19:27:41.585927 19767 consensus_queue.cc:237] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } }
I20260806 19:27:41.588559 19837 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: TxnStatusTablet state changed. Reason: New leader eb512203e9894ef083708b220f84437c. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.589053 19837 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:41.591132 19839 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 19:27:41.591491 19839 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 19:27:41.591020 19052 catalog_manager.cc:5495] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c reported cstate change: term changed from 0 to 1, leader changed from <none> to eb512203e9894ef083708b220f84437c (127.17.18.65). New cstate: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } health_report { overall_health: UNKNOWN } } }
I20260806 19:27:41.674678 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.662655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39162 (local address 127.17.18.65:40645)
0806 19:27:41.664382 (+ 1727us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.664390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.664450 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:27:41.664572 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.664577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.664773 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.665032 (+ 259us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:41.665831 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.667618 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.670483 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.671764 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.671938 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.672767 (+ 829us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.673699 (+ 932us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.673821 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.674064 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.674149 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1465,"thread_start_us":1007,"threads_started":1}
I20260806 19:27:41.674656 19819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.661008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40645 (local address 127.0.0.1:39162)
0806 19:27:41.661342 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.661367 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.661603 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.665109 (+ 3506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.665116 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.665132 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:41.665534 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.665553 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.667812 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.667818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.670206 (+ 2388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.670235 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.672021 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.672029 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.672287 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.672405 (+ 118us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.673833 (+ 1428us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.673868 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.673965 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.674160 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 19:27:41.681502 19668 raft_consensus.cc:1261] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Refusing update from remote peer eb512203e9894ef083708b220f84437c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:41.681514 19472 raft_consensus.cc:1261] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Refusing update from remote peer eb512203e9894ef083708b220f84437c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:41.682510 19767 consensus_queue.cc:1035] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:41.683161 19837 consensus_queue.cc:1035] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:41.687211 19768 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: TxnStatusTablet state changed. Reason: New leader eb512203e9894ef083708b220f84437c. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.687790 19768 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.691677 19775 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: TxnStatusTablet state changed. Reason: New leader eb512203e9894ef083708b220f84437c. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.692057 19775 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.692184 19833 mvcc.cc:205] Tried to move back new op lower bound from 7315638115037290496 to 7315638114660610048. Current Snapshot: MvccSnapshot[applied={T|T < 7315638115037290496}]
I20260806 19:27:41.694089 19767 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.694516 19767 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:41.699259 19768 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.699877 19768 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P b6655762bd554b8bb1154ba34d2feb52: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.704224 19767 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.704572 19767 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P eb512203e9894ef083708b220f84437c: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:41.715481 19775 tablet_replica.cc:439] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb512203e9894ef083708b220f84437c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb512203e9894ef083708b220f84437c" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40645 } } peers { permanent_uuid: "d071e84da0894279a76ef1af565576bf" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33647 } } peers { permanent_uuid: "b6655762bd554b8bb1154ba34d2feb52" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37419 } } }
I20260806 19:27:41.717005 19775 tablet_replica.cc:442] T a731001202174f1d8f070b75e6e0d48d P d071e84da0894279a76ef1af565576bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:41.728900 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.719024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37214 (local address 127.17.18.67:37419)
0806 19:27:41.719337 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.719344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.720565 (+ 1221us) server_negotiation.cc:407] Connection header received
0806 19:27:41.720815 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.720819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.720922 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.721068 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:41.721838 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.723680 (+ 1842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.726134 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.726779 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.726918 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.727541 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.728232 (+ 691us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.728426 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.728480 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.728576 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260806 19:27:41.756786 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.745488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:40433 (local address 127.17.18.65:40645)
0806 19:27:41.745719 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.745738 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.747582 (+ 1844us) server_negotiation.cc:407] Connection header received
0806 19:27:41.747921 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.747927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.748021 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.748163 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:41.749030 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.750787 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.753879 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.755033 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.755183 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.755826 (+ 643us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.755985 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.756093 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.756287 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.756379 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:27:41.757123 19858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.745583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40645 (local address 127.17.18.67:40433)
0806 19:27:41.747337 (+ 1754us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.747385 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.747712 (+ 327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.748190 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.748196 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.748210 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:41.748808 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.748824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.750955 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.750960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.753675 (+ 2715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.753700 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.755307 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.755313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.755496 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.755583 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.756123 (+ 540us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.756137 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.756229 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.756410 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1459,"thread_start_us":1120,"threads_started":1}
I20260806 19:27:41.817948 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.806230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:45959 (local address 127.17.18.67:37419)
0806 19:27:41.806639 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.806647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.808317 (+ 1670us) server_negotiation.cc:407] Connection header received
0806 19:27:41.808740 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.808747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.808862 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.808972 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:41.810338 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.811620 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.814638 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.815770 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.815925 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.816742 (+ 817us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.816938 (+ 196us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.817020 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.817325 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.817443 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266}
I20260806 19:27:41.818223 19862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.806443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37419 (local address 127.17.18.65:45959)
0806 19:27:41.808135 (+ 1692us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:41.808154 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:41.808551 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:41.809064 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:41.809068 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:41.809079 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:41.810082 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.810097 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.811800 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.811806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.814452 (+ 2646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:41.814473 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.816190 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.816202 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:41.816399 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.816477 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:41.817185 (+ 708us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:41.817196 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 19:27:41.817275 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 19:27:41.817466 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1411,"thread_start_us":1133,"threads_started":1}
I20260806 19:27:41.876168 19050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:41.876459 19050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:41.880808 19050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6e23d67ea54b4ab98d9c248a0a136ed9: Sending DeleteTablet for 3 replicas of tablet 4a30ee87416643c9a98c3822b417ce0d
I20260806 19:27:41.882453 19443 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a30ee87416643c9a98c3822b417ce0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:41 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:41512
I20260806 19:27:41.882830 19254 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a30ee87416643c9a98c3822b417ce0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:41 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39158
I20260806 19:27:41.883754 19639 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a30ee87416643c9a98c3822b417ce0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:41 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:37212
I20260806 19:27:41.910596 19870 tablet_replica.cc:330] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: stopping tablet replica
I20260806 19:27:41.910981 19870 raft_consensus.cc:2229] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:41.911480 19870 raft_consensus.cc:2258] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:41.912946 19870 ts_tablet_manager.cc:1905] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:41.916425 19873 tablet_replica.cc:330] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: stopping tablet replica
I20260806 19:27:41.916754 19873 raft_consensus.cc:2229] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:41.922199 19872 tablet_replica.cc:330] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: stopping tablet replica
I20260806 19:27:41.922530 19872 raft_consensus.cc:2229] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:41.923913 19872 raft_consensus.cc:2258] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:41.925345 19872 ts_tablet_manager.cc:1905] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:41.929754 19873 raft_consensus.cc:2258] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:41.931207 19873 ts_tablet_manager.cc:1905] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:41.933468 19870 ts_tablet_manager.cc:1918] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:41.933703 19870 log.cc:1196] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/4a30ee87416643c9a98c3822b417ce0d
Aug 06 19:27:41 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:41.934253 19870 ts_tablet_manager.cc:1939] T 4a30ee87416643c9a98c3822b417ce0d P d071e84da0894279a76ef1af565576bf: Deleting consensus metadata
I20260806 19:27:41.935719 19034 catalog_manager.cc:4841] TS d071e84da0894279a76ef1af565576bf (127.17.18.66:33647): tablet 4a30ee87416643c9a98c3822b417ce0d (table test-table [id=082e5d85fc814b808d741312feaf4ac2]) successfully deleted
I20260806 19:27:41.940168 19873 ts_tablet_manager.cc:1918] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:41.940409 19873 log.cc:1196] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/4a30ee87416643c9a98c3822b417ce0d
I20260806 19:27:41.941108 19873 ts_tablet_manager.cc:1939] T 4a30ee87416643c9a98c3822b417ce0d P b6655762bd554b8bb1154ba34d2feb52: Deleting consensus metadata
I20260806 19:27:41.939203 19872 ts_tablet_manager.cc:1918] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:41.941684 19872 log.cc:1196] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/4a30ee87416643c9a98c3822b417ce0d
I20260806 19:27:41.942480 19872 ts_tablet_manager.cc:1939] T 4a30ee87416643c9a98c3822b417ce0d P eb512203e9894ef083708b220f84437c: Deleting consensus metadata
I20260806 19:27:41.943835 19032 catalog_manager.cc:4841] TS eb512203e9894ef083708b220f84437c (127.17.18.65:40645): tablet 4a30ee87416643c9a98c3822b417ce0d (table test-table [id=082e5d85fc814b808d741312feaf4ac2]) successfully deleted
I20260806 19:27:41.946296 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.894788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.17.18.65:40645)
0806 19:27:41.895059 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.895066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.902440 (+ 7374us) server_negotiation.cc:407] Connection header received
0806 19:27:41.905181 (+ 2741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.905189 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.905304 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.905517 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:41.914237 (+ 8720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.916443 (+ 2206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.925698 (+ 9255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.926394 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.926529 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.936283 (+ 9754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:41.936306 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:41.936329 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:41.936386 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:41.941753 (+ 5367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.942962 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.942973 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.942976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.943177 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.943739 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.943743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.943746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.944422 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:41.944783 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.945510 (+ 727us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.945767 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:27:41.947525 19035 catalog_manager.cc:4841] TS b6655762bd554b8bb1154ba34d2feb52 (127.17.18.67:37419): tablet 4a30ee87416643c9a98c3822b417ce0d (table test-table [id=082e5d85fc814b808d741312feaf4ac2]) successfully deleted
W20260806 19:27:41.947805 19340 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176
I20260806 19:27:41.981813 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.953061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35672 (local address 127.17.18.126:34211)
0806 19:27:41.954369 (+ 1308us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.954377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.960702 (+ 6325us) server_negotiation.cc:407] Connection header received
0806 19:27:41.960950 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.960956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.961057 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.961247 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:41.963811 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.965357 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.967089 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.967672 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.967805 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.971772 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:41.971779 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:41.971784 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:41.971833 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:41.977263 (+ 5430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.978766 (+ 1503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.978773 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.978777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.979068 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:41.979636 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:41.979641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:41.979643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:41.980033 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:41.980439 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:41.980754 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 19:27:41.981103 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1123,"thread_start_us":739,"threads_started":1}
W20260806 19:27:41.982674 19050 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35672
I20260806 19:27:41.985302 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19155
I20260806 19:27:42.005419 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:41.986549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39190 (local address 127.17.18.65:40645)
0806 19:27:41.986780 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:41.986787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:41.988029 (+ 1242us) server_negotiation.cc:407] Connection header received
0806 19:27:41.988365 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:41.988371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:41.988458 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:41.988548 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:41.990013 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.990740 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.992021 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:41.992507 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:41.992626 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:41.996462 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:41.996469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:41.996472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:41.996516 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:42.000781 (+ 4265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.001789 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.001796 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.001800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.002032 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.002614 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.002619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.002623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.003238 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:42.003706 (+ 468us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:42.004286 (+ 580us) server_negotiation.cc:299] Negotiation successful
0806 19:27:42.004657 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 19:27:42.006255 19340 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39190
W20260806 19:27:42.007140 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19155: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:42.007644 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 19155
I20260806 19:27:42.037822 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19354
Aug 06 19:27:42 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:27:42.060648 19882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:42.038758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.17.18.66:33647)
0806 19:27:42.039293 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:42.039297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:42.039315 (+ 18us) server_negotiation.cc:407] Connection header received
0806 19:27:42.039371 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:42.039374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:42.039441 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:42.039743 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:42.041843 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:42.042764 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:42.045003 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:42.045558 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:42.045677 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:42.052618 (+ 6941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:42.052639 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:42.052658 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:42.052708 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:42.056056 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.057350 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.057369 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.057372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.057780 (+ 408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.058680 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.058688 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.058691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.059279 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:42.059564 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:42.060049 (+ 485us) server_negotiation.cc:299] Negotiation successful
0806 19:27:42.060279 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":284,"threads_started":1}
W20260806 19:27:42.061537 19532 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41520
W20260806 19:27:42.062515 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19354: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:42.062767 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 19354
I20260806 19:27:42.097996 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19545
Aug 06 19:27:42 dist-test-slave-f0tn krb5kdc[18984](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044460, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:27:42.117959 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:42.098881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.17.18.67:37419)
0806 19:27:42.099165 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:42.099170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:42.099191 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:27:42.099253 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:42.099257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:42.099328 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:42.099415 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:42.101185 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:42.102290 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:42.104268 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:42.104770 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:42.104896 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:42.110701 (+ 5805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:42.110719 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:42.110740 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:42.110791 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:42.114299 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.115424 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.115435 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.115437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.115608 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:42.116129 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:42.116134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:42.116137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:42.116658 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:42.116917 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:42.117363 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 19:27:42.117633 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 19:27:42.118752 19726 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37218
W20260806 19:27:42.119481 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19545: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:42.119728 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 19545
I20260806 19:27:42.144173 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19006
I20260806 19:27:42.145608 19111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:42.269184 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 19006
2026-08-06T19:27:42Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5834 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:42 dist-test-slave-f0tn krb5kdc[19886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:42 dist-test-slave-f0tn krb5kdc[19886](info): set up 2 sockets
Aug 06 19:27:42 dist-test-slave-f0tn krb5kdc[19886](info): commencing operation
krb5kdc: starting...
W20260806 19:27:43.518275 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:43 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:43.739460 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45391
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:44.136646 19910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:44.136973 19910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:44.137094 19910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:44.145113 19910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:44.145241 19910 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 19:27:44.145291 19910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:44.145412 19910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:44.145471 19910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:44.145589 19910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:44.156200 19910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45391
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:44.157703 19910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:44.159222 19910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:44.171758 19915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:44.171978 19916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:44.171769 19919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:44.173117 19910 server_base.cc:1034] running on GCE node
I20260806 19:27:44.174042 19910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:44.175616 19910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:44.176887 19910 hybrid_clock.cc:648] HybridClock initialized: now 1786044464176815 us; error 38 us; skew 500 ppm
I20260806 19:27:44.177281 19910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:44 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:44.180730 19910 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:44.182463 19910 webserver.cc:460] Webserver started at http://127.17.18.126:38817/ using document root <none> and password file <none>
I20260806 19:27:44.183221 19910 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:44.183316 19910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:44.183645 19910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:44.186896 19910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "0f70db13f01649d9bf483e6f69826b0b"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "7d11b375978f6ad5c4801f87941d8dd7"
server_key_iv: "55d3db62bc193bc6a2e0767950ad6a19"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.187721 19910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "0f70db13f01649d9bf483e6f69826b0b"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "7d11b375978f6ad5c4801f87941d8dd7"
server_key_iv: "55d3db62bc193bc6a2e0767950ad6a19"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.193538 19910 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260806 19:27:44.197588 19929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:44.199106 19910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:44.199296 19910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "0f70db13f01649d9bf483e6f69826b0b"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "7d11b375978f6ad5c4801f87941d8dd7"
server_key_iv: "55d3db62bc193bc6a2e0767950ad6a19"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.199532 19910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:44.215484 19910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:44.220145 19910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:44.220439 19910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:44.242645 19910 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45391
I20260806 19:27:44.242846 20023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45391 every 8 connection(s)
I20260806 19:27:44.244153 19910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:44.248639 20024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:44.253516 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 19910
I20260806 19:27:44.253800 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:44.254652 17481 external_mini_cluster.cc:1428] Setting key 573b995fbda540ffeeaa35adbe37a7fd
I20260806 19:27:44.261461 20024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Bootstrap starting.
I20260806 19:27:44.265545 20024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:44.266812 20024 log.cc:824] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:27:44 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:44.270737 20024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: No bootstrap required, opened a new log
I20260806 19:27:44.280586 20024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } }
I20260806 19:27:44.281131 20024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:44.281256 20024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f70db13f01649d9bf483e6f69826b0b, State: Initialized, Role: FOLLOWER
I20260806 19:27:44.281622 20027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:44.256860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41212 (local address 127.17.18.126:45391)
0806 19:27:44.257769 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:44.257782 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:44.257827 (+ 45us) server_negotiation.cc:407] Connection header received
0806 19:27:44.259719 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:44.259750 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:44.260212 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:44.260573 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:44.262640 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.264096 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.266009 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.266771 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.266939 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:44.272041 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:44.272051 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:44.272071 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:44.272123 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:44.275877 (+ 3754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.276934 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.276947 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.276956 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.277191 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.277761 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.277771 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.277775 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.278702 (+ 927us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:44.279058 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:44.279501 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 19:27:44.280012 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":419,"threads_started":1}
I20260806 19:27:44.282061 20024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } }
I20260806 19:27:44.282330 20024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:44.282465 20024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:44.282639 20024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:44.285773 20024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } }
I20260806 19:27:44.286353 20024 leader_election.cc:302] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f70db13f01649d9bf483e6f69826b0b; no voters:
I20260806 19:27:44.286937 20024 leader_election.cc:288] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:44.287081 20029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:44.287788 20029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [term 1 LEADER]: Becoming Leader. State: Replica: 0f70db13f01649d9bf483e6f69826b0b, State: Running, Role: LEADER
I20260806 19:27:44.288381 20029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } }
I20260806 19:27:44.289173 20024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:44.291577 20033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f70db13f01649d9bf483e6f69826b0b. Latest consensus state: current_term: 1 leader_uuid: "0f70db13f01649d9bf483e6f69826b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } } }
I20260806 19:27:44.292098 20033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:44.291611 20031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f70db13f01649d9bf483e6f69826b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f70db13f01649d9bf483e6f69826b0b" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45391 } } }
I20260806 19:27:44.297762 20031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b [sys.catalog]: This master's current role is: LEADER
W20260806 19:27:44.306386 20054 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:27:44.306540 20054 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:27:44.306682 20044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:44.308969 20044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:44.319249 20044 catalog_manager.cc:1347] Generated new cluster ID: 8489d2e9d8f14913b3ef93607d278c4b
I20260806 19:27:44.319420 20044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:44.340601 20044 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:44.342270 20044 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:44.354545 20044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Generated new TSK 0
I20260806 19:27:44.355512 20044 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:44.422214 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45391
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:44.785324 20061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:44.785699 20061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:44.785849 20061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:44.793469 20061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:44.793628 20061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:44.793771 20061 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 19:27:44.793854 20061 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:44.793944 20061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:27:44.804525 20061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:45391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:44.806005 20061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:44.807440 20061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:44.821357 20069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:44.821310 20075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:44.821400 20071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:44.822486 20061 server_base.cc:1034] running on GCE node
I20260806 19:27:44.823185 20061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:44.824213 20061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:44.825474 20061 hybrid_clock.cc:648] HybridClock initialized: now 1786044464825405 us; error 51 us; skew 500 ppm
I20260806 19:27:44.825879 20061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:44 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:44.829264 20061 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:27:44.830969 20061 webserver.cc:460] Webserver started at http://127.17.18.65:44255/ using document root <none> and password file <none>
I20260806 19:27:44.831712 20061 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:44.831837 20061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:44.832171 20061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:44.835525 20061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "6e11ccf530544b58a7ab4dc009d073e7"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "a3c08d21f94fda49e5718b960ced6b63"
server_key_iv: "608591c6190f43af849c3a03c1523a4a"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.836362 20061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "6e11ccf530544b58a7ab4dc009d073e7"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "a3c08d21f94fda49e5718b960ced6b63"
server_key_iv: "608591c6190f43af849c3a03c1523a4a"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.842144 20061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 19:27:44.846300 20087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:44.847914 20061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:44.848126 20061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "6e11ccf530544b58a7ab4dc009d073e7"
format_stamp: "Formatted at 2026-08-06 19:27:44 on dist-test-slave-f0tn"
server_key: "a3c08d21f94fda49e5718b960ced6b63"
server_key_iv: "608591c6190f43af849c3a03c1523a4a"
server_key_version: "encryptionkey@0"
I20260806 19:27:44.848357 20061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:44.876847 20061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:44.882129 20061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:44.882429 20061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:44.885346 20061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:44.885497 20061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260806 19:27:44.885619 20061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:44.885708 20061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:44 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:44.910817 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:44.886203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43965 (local address 127.17.18.126:45391)
0806 19:27:44.889083 (+ 2880us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:44.889089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:44.889115 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:27:44.891031 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:44.891038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:44.891143 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:44.891235 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:44.894048 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.895298 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.897922 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.898512 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.898673 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:44.903894 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:44.903900 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:44.903903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:44.903963 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:44.906748 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.907925 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.907929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.907932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.908062 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.908580 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.908583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.908585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.908860 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:44.908978 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:44.910130 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0806 19:27:44.910420 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2742,"thread_start_us":2620,"threads_started":1}
I20260806 19:27:44.912681 20100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:44.887093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.65:43965)
0806 19:27:44.888203 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:44.888279 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:44.890627 (+ 2348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:44.891861 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:44.891878 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:44.892774 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:44.893752 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:44.893792 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.895539 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.895545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:44.897707 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:44.897734 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.898806 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.898821 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:44.899187 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:44.900094 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:44.900122 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:44.903552 (+ 3430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:44.906925 (+ 3373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:44.906939 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:44.906965 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:44.907773 (+ 808us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:44.908165 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:44.908170 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:44.908175 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:44.908468 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:44.908983 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:44.908993 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:44.909604 (+ 611us) client_negotiation.cc:769] Sending connection context
0806 19:27:44.910006 (+ 402us) client_negotiation.cc:240] Negotiation successful
0806 19:27:44.910727 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":430,"threads_started":1}
I20260806 19:27:44.932801 20061 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:34949
I20260806 19:27:44.932816 20253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:34949 every 8 connection(s)
I20260806 19:27:44.934544 20061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:27:44.935942 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:44.919778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:60085 (local address 127.17.18.126:45391)
0806 19:27:44.919970 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:44.919976 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:44.920850 (+ 874us) server_negotiation.cc:407] Connection header received
0806 19:27:44.920987 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:44.920993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:44.921094 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:44.921205 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:44.922814 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.923953 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.926209 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.926884 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.927023 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:44.929576 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:44.929583 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:44.929589 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:44.929640 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:44.932750 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.933558 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.933564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.933567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.933761 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:44.934190 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:44.934195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:44.934198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:44.934631 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:44.934814 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:44.935251 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 19:27:44.935551 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:27:44.935992 20198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:44.919760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.65:60085)
0806 19:27:44.920728 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:44.920747 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:44.920880 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:44.921299 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:44.921304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:44.922022 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:44.922521 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:44.922536 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.924154 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.924160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:44.925931 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:44.925952 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:44.927090 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:44.927098 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:44.927335 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:44.928100 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:44.928123 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:44.929282 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:44.932907 (+ 3625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:44.932913 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:44.932918 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:44.933356 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:44.933903 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:44.933907 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:44.933909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:44.934049 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:44.934749 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:44.934753 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:44.934935 (+ 182us) client_negotiation.cc:769] Sending connection context
0806 19:27:44.935055 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 19:27:44.935485 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":631,"threads_started":1}
I20260806 19:27:44.936900 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 20061
I20260806 19:27:44.937139 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:27:44.937105 20254 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45391
I20260806 19:27:44.937422 20254 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:44.937999 17481 external_mini_cluster.cc:1428] Setting key 89eaa70bd365f063cf5ba1bc26c74149
I20260806 19:27:44.938413 20254 heartbeater.cc:511] Master 127.17.18.126:45391 requested a full tablet report, sending...
I20260806 19:27:44.941155 19957 ts_manager.cc:194] Registered new tserver with Master: 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949)
I20260806 19:27:44.943325 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:43965
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:27:44.989056 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45391
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:45.336721 20261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:45.337055 20261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:45.337175 20261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:45.344789 20261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:45.344928 20261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:45.345018 20261 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 19:27:45.345070 20261 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:45.345134 20261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:27:45.355870 20261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:45391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:45.357270 20261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:45.358740 20261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:45.372679 20273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:45.372721 20270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:45.372761 20269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:45.373709 20261 server_base.cc:1034] running on GCE node
I20260806 19:27:45.374364 20261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:45.375372 20261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:45.376595 20261 hybrid_clock.cc:648] HybridClock initialized: now 1786044465376539 us; error 47 us; skew 500 ppm
I20260806 19:27:45.376940 20261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:45 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:45.380291 20261 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:27:45.382131 20261 webserver.cc:460] Webserver started at http://127.17.18.66:42355/ using document root <none> and password file <none>
I20260806 19:27:45.382938 20261 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:45.383075 20261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:45.383414 20261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:45.386703 20261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "599f26ec9929dadf55580370d23136b6"
server_key_iv: "6d3ab472492fa6dd4c8a52cf9d23c552"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.387552 20261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "599f26ec9929dadf55580370d23136b6"
server_key_iv: "6d3ab472492fa6dd4c8a52cf9d23c552"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.393587 20261 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:27:45.397625 20280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:45.399292 20261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:27:45.399495 20261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "599f26ec9929dadf55580370d23136b6"
server_key_iv: "6d3ab472492fa6dd4c8a52cf9d23c552"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.399720 20261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:45.421022 20261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:45.425761 20261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:45.426064 20261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:45.428979 20261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:45.429106 20261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:45.429239 20261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:45.429328 20261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:45 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:45.453421 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.429430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:39109 (local address 127.17.18.126:45391)
0806 19:27:45.429606 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:45.429613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:45.431237 (+ 1624us) server_negotiation.cc:407] Connection header received
0806 19:27:45.433555 (+ 2318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:45.433561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:45.433654 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:45.433747 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:45.436217 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.437242 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.439705 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.440322 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.440450 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.445735 (+ 5285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:45.445744 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:45.445749 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:45.445799 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:45.449456 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:45.450652 (+ 1196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:45.450658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:45.450660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:45.450806 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:45.451328 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:45.451334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:45.451337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:45.451677 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:45.451841 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:45.452745 (+ 904us) server_negotiation.cc:299] Negotiation successful
0806 19:27:45.452998 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 19:27:45.454697 20291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.430138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.66:39109)
0806 19:27:45.431036 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:45.431079 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:45.433145 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:45.434100 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:45.434113 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:45.435018 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:45.435977 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.436019 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.437480 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.437484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.439535 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.439551 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.440614 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.440623 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.440934 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.441905 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:45.441944 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:45.445361 (+ 3417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:45.449684 (+ 4323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:45.449696 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:45.449724 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:45.450480 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:45.450930 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:45.450935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:45.450939 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:45.451188 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:45.451820 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:45.451829 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:45.452298 (+ 469us) client_negotiation.cc:769] Sending connection context
0806 19:27:45.452606 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 19:27:45.453229 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":393,"threads_started":1}
I20260806 19:27:45.478355 20261 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:33247
I20260806 19:27:45.478351 20446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:33247 every 8 connection(s)
I20260806 19:27:45.479920 20261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:27:45.481880 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.462141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:36987 (local address 127.17.18.126:45391)
0806 19:27:45.462371 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:45.462377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:45.466450 (+ 4073us) server_negotiation.cc:407] Connection header received
0806 19:27:45.466669 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:45.466676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:45.466787 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:45.466912 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:45.468111 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.469259 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.471003 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.471675 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.471806 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.474634 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:45.474642 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:45.474647 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:45.474694 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:45.478622 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:45.479343 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:45.479348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:45.479351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:45.479550 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:45.479924 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:45.479930 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:45.479932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:45.480405 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:45.480589 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:45.481185 (+ 596us) server_negotiation.cc:299] Negotiation successful
0806 19:27:45.481479 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 19:27:45.481909 20405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.462347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.66:36987)
0806 19:27:45.466269 (+ 3922us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:45.466294 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:45.466508 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:45.466977 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:45.466983 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:45.467596 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:45.467923 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.467934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.469439 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.469443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.470770 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.470794 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.471928 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.471934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.472073 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.472826 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:45.472856 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:45.474374 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:45.478771 (+ 4397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:45.478775 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:45.478778 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:45.479194 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:45.479668 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:45.479672 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:45.479674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:45.479799 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:45.480573 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:45.480580 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:45.480858 (+ 278us) client_negotiation.cc:769] Sending connection context
0806 19:27:45.481030 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 19:27:45.481434 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3740,"thread_start_us":3614,"threads_started":1}
I20260806 19:27:45.482635 20447 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45391
I20260806 19:27:45.483474 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 20261
I20260806 19:27:45.483637 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:27:45.484056 17481 external_mini_cluster.cc:1428] Setting key 73b50cc6b303f0f57f72295af81b1c9c
I20260806 19:27:45.482942 20447 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:45.485493 20447 heartbeater.cc:511] Master 127.17.18.126:45391 requested a full tablet report, sending...
I20260806 19:27:45.486989 19957 ts_manager.cc:194] Registered new tserver with Master: 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247)
I20260806 19:27:45.487819 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:39109
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:27:45.533316 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45391
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:33685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:45.879639 20451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:45.879956 20451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:45.880097 20451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:45.887728 20451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:45.887866 20451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:45.887987 20451 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 19:27:45.888062 20451 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:27:45.888154 20451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:27:45.898994 20451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:45391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:45.900449 20451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:45.901981 20451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:45.916540 20459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:45.916505 20460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:45.916558 20464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:45.917299 20451 server_base.cc:1034] running on GCE node
I20260806 19:27:45.918012 20451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:45.919062 20451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:45.920301 20451 hybrid_clock.cc:648] HybridClock initialized: now 1786044465920226 us; error 62 us; skew 500 ppm
I20260806 19:27:45.920667 20451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:45 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:45.924345 20451 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:27:45.926138 20451 webserver.cc:460] Webserver started at http://127.17.18.67:46863/ using document root <none> and password file <none>
I20260806 19:27:45.926891 20451 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:45.927013 20451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:45.927350 20451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:45.930603 20451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "88f47e4848414096a85d6353fa7ce9da"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "3a8e483df46a4ece8e9a900401c3c562"
server_key_iv: "4e08a9c854ddf8bdf14d8ac8d0f8e6ac"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.931417 20451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "88f47e4848414096a85d6353fa7ce9da"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "3a8e483df46a4ece8e9a900401c3c562"
server_key_iv: "4e08a9c854ddf8bdf14d8ac8d0f8e6ac"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.938719 20451 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260806 19:27:45.942830 20480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:45.944458 20451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 19:27:45.944659 20451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "88f47e4848414096a85d6353fa7ce9da"
format_stamp: "Formatted at 2026-08-06 19:27:45 on dist-test-slave-f0tn"
server_key: "3a8e483df46a4ece8e9a900401c3c562"
server_key_iv: "4e08a9c854ddf8bdf14d8ac8d0f8e6ac"
server_key_version: "encryptionkey@0"
I20260806 19:27:45.944875 20451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:45.946530 20254 heartbeater.cc:503] Master 127.17.18.126:45391 was elected leader, sending a full tablet report...
I20260806 19:27:45.967612 20451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:45.972517 20451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:45.972824 20451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:45.975955 20451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:45.976089 20451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:45.976209 20451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:45.976282 20451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:27:45 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044465, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:46.003918 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.976864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:55925 (local address 127.17.18.126:45391)
0806 19:27:45.977037 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:45.977042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:45.978864 (+ 1822us) server_negotiation.cc:407] Connection header received
0806 19:27:45.981258 (+ 2394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:45.981264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:45.981357 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:45.981501 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:45.984582 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.985639 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.988804 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.989354 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.989539 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.995116 (+ 5577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:45.995126 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:45.995132 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:45.995193 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:45.999307 (+ 4114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.000731 (+ 1424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.000739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.000743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.000927 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.001497 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.001503 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.001507 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.001917 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:46.002095 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.003342 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.003568 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 19:27:46.005712 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:45.977709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.67:55925)
0806 19:27:45.978649 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:45.978715 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:45.980893 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:45.982003 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:45.982017 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:45.983023 (+ 1006us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:45.984204 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.984243 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.985836 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.985843 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.988538 (+ 2695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:45.988596 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:45.989692 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:45.989702 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:45.990067 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:45.991035 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:45.991082 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:45.994727 (+ 3645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:45.999605 (+ 4878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:45.999620 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:45.999646 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.000527 (+ 881us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.001082 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:46.001088 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:46.001091 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.001343 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.002111 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:46.002123 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:46.002744 (+ 621us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.003148 (+ 404us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.003852 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":401,"threads_started":1}
I20260806 19:27:46.029904 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.012697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.17.18.67:45899)
0806 19:27:46.013416 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.013437 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.013612 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.014044 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.014050 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.014835 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:46.015579 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.015599 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.016950 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.016956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.018860 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.018885 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.019882 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.019890 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.020083 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.020844 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:46.020870 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:46.022425 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:46.026689 (+ 4264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:46.026694 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:46.026697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.027243 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.027723 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:46.027729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:46.027733 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.027929 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.028594 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:46.028598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:46.028866 (+ 268us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.029038 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.029458 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":368,"threads_started":1}
I20260806 19:27:46.030342 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.012743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:45899 (local address 127.17.18.126:45391)
0806 19:27:46.012968 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.012976 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.013544 (+ 568us) server_negotiation.cc:407] Connection header received
0806 19:27:46.013752 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.013758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.013864 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.013967 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:46.015814 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.016769 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.019191 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.019656 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.019784 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.022722 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:46.022730 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:46.022735 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:46.022787 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:46.026491 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.027391 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.027400 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.027404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.027594 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.028066 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.028072 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.028075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.028480 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:46.028643 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.029655 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.029955 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:27:46.036798 20451 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:38423
I20260806 19:27:46.036831 20656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:38423 every 8 connection(s)
I20260806 19:27:46.038251 20451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:27:46.040397 20658 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45391
I20260806 19:27:46.040633 20658 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:46.041320 20658 heartbeater.cc:511] Master 127.17.18.126:45391 requested a full tablet report, sending...
I20260806 19:27:46.042836 19957 ts_manager.cc:194] Registered new tserver with Master: 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423)
I20260806 19:27:46.043730 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:55925
I20260806 19:27:46.048038 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 20451
I20260806 19:27:46.048251 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:27:46.048681 17481 external_mini_cluster.cc:1428] Setting key 10a46217de4064e4a4b0ba2e2be9ef48
I20260806 19:27:46.052572 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:27:46 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 19:27:46 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:46.110966 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.095986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50866 (local address 127.17.18.126:45391)
0806 19:27:46.096272 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.096279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.096392 (+ 113us) server_negotiation.cc:407] Connection header received
0806 19:27:46.096599 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.096606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.096678 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.096767 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:46.098271 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.099010 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.100294 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.100734 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.100851 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.105178 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:46.105185 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:46.105188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:46.105233 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:46.108078 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.108848 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.108854 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.108858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.109016 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.109454 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.109460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.109463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.109774 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:46.110026 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.110351 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.110616 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260806 19:27:46.115974 19957 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:46.123696 19957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:46.151708 20673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.139186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33247 (local address 127.0.0.1:34440)
0806 19:27:46.140865 (+ 1679us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.140930 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.141143 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.143184 (+ 2041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.143188 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.143213 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.143509 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.143519 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.145374 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.145426 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.147976 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.147992 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.150495 (+ 2503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.150538 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.150790 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.150851 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.151017 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.151246 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1459,"mutex_wait_us":58,"thread_start_us":1196,"threads_started":1}
I20260806 19:27:46.151787 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.138664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39826 (local address 127.17.18.67:38423)
0806 19:27:46.140203 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.140210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.141048 (+ 838us) server_negotiation.cc:407] Connection header received
0806 19:27:46.141442 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.141453 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.141788 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.141981 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.143748 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.145043 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.147720 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.149831 (+ 2111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.150023 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.150338 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.151223 (+ 885us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.151424 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":681,"threads_started":1}
I20260806 19:27:46.152633 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.138533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38423 (local address 127.0.0.1:39826)
0806 19:27:46.140865 (+ 2332us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.140930 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.141143 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.142278 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.142286 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.142321 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.142780 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.142794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.145193 (+ 2399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.145198 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.147525 (+ 2327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.147541 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.150793 (+ 3252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.150800 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.150993 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.151027 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.152005 (+ 978us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.152214 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2004,"mutex_wait_us":40,"thread_start_us":1846,"threads_started":1}
I20260806 19:27:46.153093 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.139527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.17.18.66:33247)
0806 19:27:46.140195 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.140206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.141183 (+ 977us) server_negotiation.cc:407] Connection header received
0806 19:27:46.142431 (+ 1248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.142442 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.142728 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.142930 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.143690 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.145139 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.148191 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.150183 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.150347 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.150549 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.152393 (+ 1844us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.152620 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":356,"threads_started":1}
I20260806 19:27:46.153321 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.141673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36682 (local address 127.17.18.65:34949)
0806 19:27:46.143362 (+ 1689us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.143369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.143392 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:27:46.143475 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.143480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.143638 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.143836 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.144972 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.146822 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.149295 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.151338 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.151498 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.151706 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.152768 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.152960 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1536,"thread_start_us":1378,"threads_started":1}
I20260806 19:27:46.153329 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.141326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.0.0.1:36682)
0806 19:27:46.141933 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.141951 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.142075 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.143828 (+ 1753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.143832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.143857 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.144271 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.144284 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.147054 (+ 2770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.147059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.148841 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.148854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.152021 (+ 3167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.152029 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.152221 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.152264 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.152371 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.152514 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":326,"threads_started":1}
I20260806 19:27:46.156932 20350 tablet_service.cc:1467] Processing CreateTablet for tablet 308c3ace2bff4f1697810848322eb13d (DEFAULT_TABLE table=test-table [id=b598833623ee419bb0dbd8e799631880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.157303 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 308c3ace2bff4f1697810848322eb13d (DEFAULT_TABLE table=test-table [id=b598833623ee419bb0dbd8e799631880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.157300 20555 tablet_service.cc:1467] Processing CreateTablet for tablet 308c3ace2bff4f1697810848322eb13d (DEFAULT_TABLE table=test-table [id=b598833623ee419bb0dbd8e799631880]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.158835 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 308c3ace2bff4f1697810848322eb13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.159205 20555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 308c3ace2bff4f1697810848322eb13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.159246 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 308c3ace2bff4f1697810848322eb13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.172124 20682 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Bootstrap starting.
I20260806 19:27:46.175209 20684 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Bootstrap starting.
I20260806 19:27:46.177032 20685 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Bootstrap starting.
I20260806 19:27:46.177538 20682 tablet_bootstrap.cc:654] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.179026 20682 log.cc:824] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:46.180428 20685 tablet_bootstrap.cc:654] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.180567 20684 tablet_bootstrap.cc:654] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.181741 20684 log.cc:824] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:46.181807 20685 log.cc:824] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:46.182902 20682 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: No bootstrap required, opened a new log
I20260806 19:27:46.183229 20682 ts_tablet_manager.cc:1397] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260806 19:27:46.184793 20685 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: No bootstrap required, opened a new log
I20260806 19:27:46.184924 20684 tablet_bootstrap.cc:492] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: No bootstrap required, opened a new log
I20260806 19:27:46.185087 20685 ts_tablet_manager.cc:1397] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260806 19:27:46.185185 20684 ts_tablet_manager.cc:1397] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260806 19:27:46.193071 20685 raft_consensus.cc:348] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.193586 20685 raft_consensus.cc:374] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.193698 20685 raft_consensus.cc:729] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.194105 20682 raft_consensus.cc:348] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.194559 20682 raft_consensus.cc:374] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.194660 20682 raft_consensus.cc:729] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.194511 20685 consensus_queue.cc:260] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.195294 20682 consensus_queue.cc:260] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.195911 20684 raft_consensus.cc:348] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.196388 20684 raft_consensus.cc:374] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.196472 20684 raft_consensus.cc:729] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.196563 20685 ts_tablet_manager.cc:1428] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260806 19:27:46.197135 20658 heartbeater.cc:503] Master 127.17.18.126:45391 was elected leader, sending a full tablet report...
I20260806 19:27:46.197252 20684 consensus_queue.cc:260] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.202490 20684 ts_tablet_manager.cc:1428] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Time spent starting tablet: real 0.017s user 0.018s sys 0.000s
I20260806 19:27:46.203538 20447 heartbeater.cc:503] Master 127.17.18.126:45391 was elected leader, sending a full tablet report...
I20260806 19:27:46.205740 20682 ts_tablet_manager.cc:1428] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent starting tablet: real 0.022s user 0.018s sys 0.004s
W20260806 19:27:46.234138 20448 tablet.cc:2369] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:27:46.244805 20691 raft_consensus.cc:482] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:46.245159 20691 raft_consensus.cc:504] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.247459 20691 leader_election.cc:288] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247), 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949)
I20260806 19:27:46.254515 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.248786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:38771 (local address 127.17.18.65:34949)
0806 19:27:46.248991 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.248996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.249014 (+ 18us) server_negotiation.cc:407] Connection header received
0806 19:27:46.249085 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.249090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.249188 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.249281 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.249932 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.250756 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.252610 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.253497 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.253665 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.253747 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.254085 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.254245 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 19:27:46.254823 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.247785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:50087 (local address 127.17.18.66:33247)
0806 19:27:46.247983 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.247989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.248010 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:27:46.248221 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.248226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.248305 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.248394 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.249091 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.250108 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.252621 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.253902 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.254079 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.254150 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.254427 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.254561 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:27:46.254829 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.247651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33247 (local address 127.17.18.67:50087)
0806 19:27:46.247879 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.247902 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.248041 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.248677 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.248683 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.248713 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.248930 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.248942 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.250253 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.250258 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.252415 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.252431 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.254061 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.254067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.254268 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.254300 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.254394 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.254540 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":1}
I20260806 19:27:46.255589 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.248012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.17.18.67:38771)
0806 19:27:46.248780 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.248798 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.248927 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.249314 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.249319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.249345 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.249769 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.249782 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.250908 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.250913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.252401 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.252417 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.253771 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.253778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.253904 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.253929 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.255168 (+ 1239us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.255297 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":404,"threads_started":1}
I20260806 19:27:46.256058 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "308c3ace2bff4f1697810848322eb13d" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" is_pre_election: true
I20260806 19:27:46.256671 20379 raft_consensus.cc:2454] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:46.256767 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "308c3ace2bff4f1697810848322eb13d" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7" is_pre_election: true
I20260806 19:27:46.257287 20183 raft_consensus.cc:2454] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:46.257407 20484 leader_election.cc:302] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0ee1ebcc91467f97fe2885cc7489a1, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:46.257862 20691 raft_consensus.cc:2781] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:46.258031 20691 raft_consensus.cc:482] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:46.258142 20691 raft_consensus.cc:3037] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.261461 20691 raft_consensus.cc:504] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.262234 20691 leader_election.cc:288] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Requested vote from peers 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247), 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949)
I20260806 19:27:46.262771 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "308c3ace2bff4f1697810848322eb13d" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
I20260806 19:27:46.262877 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "308c3ace2bff4f1697810848322eb13d" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7"
I20260806 19:27:46.262979 20379 raft_consensus.cc:3037] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.263103 20183 raft_consensus.cc:3037] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.265614 20183 raft_consensus.cc:2454] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:46.265859 20379 raft_consensus.cc:2454] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:46.266197 20484 leader_election.cc:302] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e11ccf530544b58a7ab4dc009d073e7, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:46.266613 20691 raft_consensus.cc:2781] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:46.267201 20691 raft_consensus.cc:686] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Becoming Leader. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Running, Role: LEADER
I20260806 19:27:46.267772 20691 consensus_queue.cc:237] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } }
I20260806 19:27:46.273492 19957 catalog_manager.cc:5495] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da reported cstate change: term changed from 0 to 1, leader changed from <none> to 88f47e4848414096a85d6353fa7ce9da (127.17.18.67). New cstate: current_term: 1 leader_uuid: "88f47e4848414096a85d6353fa7ce9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } health_report { overall_health: UNKNOWN } } }
W20260806 19:27:46.289937 20661 tablet.cc:2369] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 19:27:46 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044464, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:46.346266 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.328237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45391 (local address 127.0.0.1:50876)
0806 19:27:46.328978 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.328996 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.329143 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.329527 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.329531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.330248 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:46.330525 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.330534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.331640 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.331645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.332652 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.332665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.333497 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.333506 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.333639 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.337773 (+ 4134us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:46.337799 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:46.340388 (+ 2589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:46.343476 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:46.343508 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:46.343516 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.343964 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.344405 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:46.344409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:46.344411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:46.344585 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:46.345152 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:46.345162 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:46.345468 (+ 306us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.345651 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.345891 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":403,"threads_started":1}
I20260806 19:27:46.346283 20099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.328182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.17.18.126:45391)
0806 19:27:46.328398 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.328405 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.329108 (+ 703us) server_negotiation.cc:407] Connection header received
0806 19:27:46.329242 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.329246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.329328 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.329446 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:46.330694 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.331486 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.332810 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.333256 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.333359 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.340668 (+ 7309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:46.340675 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:46.340678 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:46.340715 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:46.343297 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.344109 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.344114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.344116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.344290 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:46.344688 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:46.344692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:46.344694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:46.345003 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:46.345129 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.345774 (+ 645us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.346018 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":79}
I20260806 19:27:46.352078 19957 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:50876:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 19:27:46.353224 19957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:46.360355 20350 tablet_service.cc:1467] Processing CreateTablet for tablet 9cbc883cfb2d4cc083d763921b8c8696 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f294332d42234571b0900b3730ea3f6d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:46.360255 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 9cbc883cfb2d4cc083d763921b8c8696 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f294332d42234571b0900b3730ea3f6d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:46.360496 20555 tablet_service.cc:1467] Processing CreateTablet for tablet 9cbc883cfb2d4cc083d763921b8c8696 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f294332d42234571b0900b3730ea3f6d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:27:46.361342 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cbc883cfb2d4cc083d763921b8c8696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.361341 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cbc883cfb2d4cc083d763921b8c8696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.361445 20555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9cbc883cfb2d4cc083d763921b8c8696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.367766 20685 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: Bootstrap starting.
I20260806 19:27:46.368620 20684 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: Bootstrap starting.
I20260806 19:27:46.369625 20685 tablet_bootstrap.cc:654] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.370165 20684 tablet_bootstrap.cc:654] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.371254 20682 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: Bootstrap starting.
I20260806 19:27:46.372282 20684 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: No bootstrap required, opened a new log
I20260806 19:27:46.372411 20684 ts_tablet_manager.cc:1397] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 19:27:46.372694 20682 tablet_bootstrap.cc:654] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.373138 20684 raft_consensus.cc:348] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.373338 20684 raft_consensus.cc:374] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.373450 20684 raft_consensus.cc:729] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.373929 20684 consensus_queue.cc:260] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.374439 20685 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: No bootstrap required, opened a new log
I20260806 19:27:46.374596 20685 ts_tablet_manager.cc:1397] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260806 19:27:46.374451 20693 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.374779 20693 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.375231 20684 ts_tablet_manager.cc:1428] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 19:27:46.375425 20685 raft_consensus.cc:348] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.375697 20685 raft_consensus.cc:374] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.375802 20685 raft_consensus.cc:729] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.376039 20685 consensus_queue.cc:260] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.376706 20685 ts_tablet_manager.cc:1428] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 19:27:46.376555 20691 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.376875 20691 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.378203 20682 tablet_bootstrap.cc:492] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: No bootstrap required, opened a new log
I20260806 19:27:46.378374 20682 ts_tablet_manager.cc:1397] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 19:27:46.379102 20682 raft_consensus.cc:348] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.379307 20682 raft_consensus.cc:374] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.379403 20682 raft_consensus.cc:729] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.379691 20682 consensus_queue.cc:260] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.380300 20682 ts_tablet_manager.cc:1428] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 19:27:46.380268 20692 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.380702 20692 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.380988 20693 raft_consensus.cc:482] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:46.381183 20693 raft_consensus.cc:504] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.382881 20693 leader_election.cc:288] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247), 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423)
I20260806 19:27:46.390048 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.383554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43195 (local address 127.17.18.66:33247)
0806 19:27:46.383744 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.383750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.384246 (+ 496us) server_negotiation.cc:407] Connection header received
0806 19:27:46.384529 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.384534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.384618 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.384717 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.385281 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.386166 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.388036 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.388839 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.388994 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.389053 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.389600 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.389738 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:27:46.390101 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.383051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33247 (local address 127.17.18.65:43195)
0806 19:27:46.384135 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.384156 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.384368 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.384752 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.384756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.384788 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.385115 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.385124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.386300 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.386306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.387879 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.387892 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.389177 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.389183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.389367 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.389443 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.389557 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.389698 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":934,"mutex_wait_us":39,"thread_start_us":783,"threads_started":1}
I20260806 19:27:46.390151 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.383829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:40177 (local address 127.17.18.67:38423)
0806 19:27:46.384014 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.384020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.384767 (+ 747us) server_negotiation.cc:407] Connection header received
0806 19:27:46.385077 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.385082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.385146 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.385219 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.385744 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.386497 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.388222 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.389112 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.389292 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.389366 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.389700 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.389843 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:27:46.390829 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.383274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38423 (local address 127.17.18.65:40177)
0806 19:27:46.384668 (+ 1394us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.384695 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.384936 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.385252 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.385256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.385281 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.385606 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.385615 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.386638 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.386643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.388067 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.388080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.389315 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.389320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.389528 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.389559 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.390370 (+ 811us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.390502 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1272,"mutex_wait_us":16,"spinlock_wait_cycles":27392,"thread_start_us":1316,"threads_started":1}
I20260806 19:27:46.391243 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cbc883cfb2d4cc083d763921b8c8696" candidate_uuid: "6e11ccf530544b58a7ab4dc009d073e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" is_pre_election: true
I20260806 19:27:46.391528 20379 raft_consensus.cc:2454] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e11ccf530544b58a7ab4dc009d073e7 in term 0.
I20260806 19:27:46.391840 20594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cbc883cfb2d4cc083d763921b8c8696" candidate_uuid: "6e11ccf530544b58a7ab4dc009d073e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f47e4848414096a85d6353fa7ce9da" is_pre_election: true
I20260806 19:27:46.391990 20090 leader_election.cc:302] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0ee1ebcc91467f97fe2885cc7489a1, 6e11ccf530544b58a7ab4dc009d073e7; no voters:
I20260806 19:27:46.392336 20594 raft_consensus.cc:2454] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e11ccf530544b58a7ab4dc009d073e7 in term 0.
I20260806 19:27:46.392419 20693 raft_consensus.cc:2781] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:46.392530 20693 raft_consensus.cc:482] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:46.392628 20693 raft_consensus.cc:3037] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.395099 20693 raft_consensus.cc:504] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.395732 20693 leader_election.cc:288] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [CANDIDATE]: Term 1 election: Requested vote from peers 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247), 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423)
I20260806 19:27:46.396267 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cbc883cfb2d4cc083d763921b8c8696" candidate_uuid: "6e11ccf530544b58a7ab4dc009d073e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
I20260806 19:27:46.396288 20594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9cbc883cfb2d4cc083d763921b8c8696" candidate_uuid: "6e11ccf530544b58a7ab4dc009d073e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f47e4848414096a85d6353fa7ce9da"
I20260806 19:27:46.396493 20594 raft_consensus.cc:3037] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.396514 20379 raft_consensus.cc:3037] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.399564 20379 raft_consensus.cc:2454] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e11ccf530544b58a7ab4dc009d073e7 in term 1.
I20260806 19:27:46.399578 20594 raft_consensus.cc:2454] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e11ccf530544b58a7ab4dc009d073e7 in term 1.
I20260806 19:27:46.400058 20088 leader_election.cc:302] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e11ccf530544b58a7ab4dc009d073e7, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:46.400453 20693 raft_consensus.cc:2781] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:46.400923 20693 raft_consensus.cc:686] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 LEADER]: Becoming Leader. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Running, Role: LEADER
I20260806 19:27:46.401484 20693 consensus_queue.cc:237] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.405326 20712 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: TxnStatusTablet state changed. Reason: New leader 6e11ccf530544b58a7ab4dc009d073e7. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.405819 20712 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:46.406507 20714 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 19:27:46.406807 20714 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 19:27:46.406948 19957 catalog_manager.cc:5495] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65). New cstate: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } health_report { overall_health: UNKNOWN } } }
I20260806 19:27:46.433110 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.426783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.17.18.65:34949)
0806 19:27:46.426949 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.426954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.426971 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:27:46.427274 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.427277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.427360 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.427472 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.427901 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.428687 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.430629 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.431098 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.431211 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.431832 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.432422 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.432570 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.432731 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.432817 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 19:27:46.433182 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.426629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.0.0.1:36698)
0806 19:27:46.426887 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.426909 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.427059 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.427522 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.427528 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.427541 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:46.427769 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.427781 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.428824 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.428830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.430458 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.430475 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.431270 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.431276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.431497 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.431582 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.432543 (+ 961us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.432579 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.432685 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.432860 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 19:27:46.441527 20379 raft_consensus.cc:1261] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Refusing update from remote peer 6e11ccf530544b58a7ab4dc009d073e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.441493 20594 raft_consensus.cc:1261] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Refusing update from remote peer 6e11ccf530544b58a7ab4dc009d073e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.442575 20712 consensus_queue.cc:1035] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:46.442945 20693 consensus_queue.cc:1035] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:27:46.443246 20257 tablet.cc:2369] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:27:46.451987 20692 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: TxnStatusTablet state changed. Reason: New leader 6e11ccf530544b58a7ab4dc009d073e7. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.452395 20692 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.457876 20717 mvcc.cc:205] Tried to move back new op lower bound from 7315638134533910528 to 7315638134384480256. Current Snapshot: MvccSnapshot[applied={T|T < 7315638134533910528}]
I20260806 19:27:46.461398 20712 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.461746 20712 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:46.464334 20691 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: TxnStatusTablet state changed. Reason: New leader 6e11ccf530544b58a7ab4dc009d073e7. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.464744 20691 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.466320 20692 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.466601 20692 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 3a0ee1ebcc91467f97fe2885cc7489a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.471392 20712 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.471745 20712 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 6e11ccf530544b58a7ab4dc009d073e7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:27:46.474396 20723 mvcc.cc:205] Tried to move back new op lower bound from 7315638134533910528 to 7315638134384480256. Current Snapshot: MvccSnapshot[applied={T|T < 7315638134533910528}]
I20260806 19:27:46.482076 20691 tablet_replica.cc:439] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e11ccf530544b58a7ab4dc009d073e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } } }
I20260806 19:27:46.482460 20691 tablet_replica.cc:442] T 9cbc883cfb2d4cc083d763921b8c8696 P 88f47e4848414096a85d6353fa7ce9da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:27:46.486214 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.470178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.17.18.67:38423)
0806 19:27:46.470350 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.470356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.470898 (+ 542us) server_negotiation.cc:407] Connection header received
0806 19:27:46.471016 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.471022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.471135 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.471283 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.471881 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.474296 (+ 2415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.482919 (+ 8623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.483579 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.483734 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.484464 (+ 730us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.485191 (+ 727us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.485333 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.485610 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.485716 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:27:46.505435 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.499155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:33195 (local address 127.17.18.65:34949)
0806 19:27:46.499346 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.499353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.499375 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:27:46.499513 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.499519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.499616 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.499739 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.500125 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.501417 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.503372 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.504065 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.504188 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.504767 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.504880 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.504958 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.505091 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.505165 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 19:27:46.505621 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.498994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.17.18.67:33195)
0806 19:27:46.499243 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.499264 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.499381 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.499755 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.499760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.499774 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:46.499970 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.499980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.501558 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.501565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.503189 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.503207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.504242 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.504249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.504427 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.504543 (+ 116us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.504976 (+ 433us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.504989 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.505079 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.505259 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 19:27:46.518915 20379 raft_consensus.cc:1261] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.519182 20183 raft_consensus.cc:1261] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.519583 20696 consensus_queue.cc:1035] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:46.520021 20691 consensus_queue.cc:1035] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:46.567862 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.560717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38423 (local address 127.17.18.65:32853)
0806 19:27:46.561706 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.561739 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.561896 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.562254 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.562259 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.562272 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:46.562707 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.562721 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.564153 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.564178 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.565502 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.565520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.566409 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.566419 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.566597 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.566677 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.567163 (+ 486us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.567173 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.567252 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.567406 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"thread_start_us":600,"threads_started":1}
I20260806 19:27:46.567975 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.560713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:32853 (local address 127.17.18.67:38423)
0806 19:27:46.560941 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.560947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.561830 (+ 883us) server_negotiation.cc:407] Connection header received
0806 19:27:46.562037 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.562042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.562116 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.562193 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.562898 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.564015 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.565645 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.566213 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.566347 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.566898 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.567047 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.567145 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.567628 (+ 483us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.567732 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 19:27:46.617826 19960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:46.618168 19960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:46.623088 19960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Sending DeleteTablet for 3 replicas of tablet 308c3ace2bff4f1697810848322eb13d
I20260806 19:27:46.624826 20555 tablet_service.cc:1514] Processing DeleteTablet for tablet 308c3ace2bff4f1697810848322eb13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:46 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39826
I20260806 19:27:46.626014 19960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 19:27:46.626391 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet 308c3ace2bff4f1697810848322eb13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:46 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:36682
W20260806 19:27:46.626739 19960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:46.627539 20350 tablet_service.cc:1514] Processing DeleteTablet for tablet 308c3ace2bff4f1697810848322eb13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:46 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:34440
I20260806 19:27:46.629294 20749 tablet_replica.cc:330] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: stopping tablet replica
I20260806 19:27:46.632958 20749 raft_consensus.cc:2229] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:46.633477 20749 raft_consensus.cc:2258] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:46.636377 20152 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (DEFAULT_TABLE table=test-table [id=3921754b035e41a39ee2f4aa0372529f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.637032 20152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd6b42dc5141dcac1ea7061bfa74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.636979 20749 ts_tablet_manager.cc:1905] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:46.642758 20554 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (DEFAULT_TABLE table=test-table [id=3921754b035e41a39ee2f4aa0372529f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.643251 20350 tablet_service.cc:1467] Processing CreateTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (DEFAULT_TABLE table=test-table [id=3921754b035e41a39ee2f4aa0372529f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:46.643517 20554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd6b42dc5141dcac1ea7061bfa74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.643707 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6bd6b42dc5141dcac1ea7061bfa74d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:46.650723 20685 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Bootstrap starting.
I20260806 19:27:46.652606 20685 tablet_bootstrap.cc:654] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.652972 20682 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Bootstrap starting.
I20260806 19:27:46.653167 20749 ts_tablet_manager.cc:1918] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:46.653355 20749 log.cc:1196] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/308c3ace2bff4f1697810848322eb13d
I20260806 19:27:46.655055 20682 tablet_bootstrap.cc:654] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.655565 20749 ts_tablet_manager.cc:1939] T 308c3ace2bff4f1697810848322eb13d P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting consensus metadata
I20260806 19:27:46.657822 19933 catalog_manager.cc:4841] TS 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247): tablet 308c3ace2bff4f1697810848322eb13d (table test-table [id=b598833623ee419bb0dbd8e799631880]) successfully deleted
I20260806 19:27:46.665663 20684 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Bootstrap starting.
I20260806 19:27:46.667814 20684 tablet_bootstrap.cc:654] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:46.672916 20682 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: No bootstrap required, opened a new log
I20260806 19:27:46.673135 20682 ts_tablet_manager.cc:1397] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260806 19:27:46.674310 20682 raft_consensus.cc:348] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.674600 20682 raft_consensus.cc:374] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.674669 20682 raft_consensus.cc:729] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.674990 20682 consensus_queue.cc:260] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.679406 20682 ts_tablet_manager.cc:1428] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260806 19:27:46.683400 20685 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: No bootstrap required, opened a new log
I20260806 19:27:46.683629 20685 ts_tablet_manager.cc:1397] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.009s
I20260806 19:27:46.684551 20685 raft_consensus.cc:348] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.684844 20685 raft_consensus.cc:374] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.684944 20685 raft_consensus.cc:729] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.685218 20685 consensus_queue.cc:260] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.685766 20684 tablet_bootstrap.cc:492] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: No bootstrap required, opened a new log
I20260806 19:27:46.686057 20684 ts_tablet_manager.cc:1397] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.002s
I20260806 19:27:46.687418 20684 raft_consensus.cc:348] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.688640 20684 raft_consensus.cc:374] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:46.688812 20684 raft_consensus.cc:729] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Initialized, Role: FOLLOWER
I20260806 19:27:46.688427 20748 tablet_replica.cc:330] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: stopping tablet replica
I20260806 19:27:46.689658 20748 raft_consensus.cc:2229] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:46.690125 20748 raft_consensus.cc:2258] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:46.690075 20692 raft_consensus.cc:482] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:46.690320 20692 raft_consensus.cc:504] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.690418 20684 consensus_queue.cc:260] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.691742 20684 ts_tablet_manager.cc:1428] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260806 19:27:46.691747 20685 ts_tablet_manager.cc:1428] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260806 19:27:46.692216 20747 tablet_replica.cc:330] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: stopping tablet replica
I20260806 19:27:46.692436 20692 leader_election.cc:288] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423)
I20260806 19:27:46.694682 20748 ts_tablet_manager.cc:1905] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:46.702435 20748 ts_tablet_manager.cc:1918] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:46.702666 20748 log.cc:1196] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/308c3ace2bff4f1697810848322eb13d
I20260806 19:27:46.703193 20748 ts_tablet_manager.cc:1939] T 308c3ace2bff4f1697810848322eb13d P 6e11ccf530544b58a7ab4dc009d073e7: Deleting consensus metadata
I20260806 19:27:46.703342 20747 raft_consensus.cc:2229] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:46.705307 19933 catalog_manager.cc:4841] TS 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949): tablet 308c3ace2bff4f1697810848322eb13d (table test-table [id=b598833623ee419bb0dbd8e799631880]) successfully deleted
I20260806 19:27:46.705852 20747 raft_consensus.cc:2258] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:46.711122 20747 ts_tablet_manager.cc:1905] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:46.712417 20755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.693119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38423 (local address 127.17.18.66:44589)
0806 19:27:46.693642 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.693664 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.693802 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.694937 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.694941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.694974 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.695330 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.695346 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.702893 (+ 7547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.702901 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.706679 (+ 3778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.706709 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.709625 (+ 2916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.709633 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.709846 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.709880 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.711915 (+ 2035us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.712065 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":2814,"threads_started":1}
I20260806 19:27:46.711849 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.693557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:44589 (local address 127.17.18.67:38423)
0806 19:27:46.693725 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.693730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.693754 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:27:46.693978 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.693983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.694068 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.694153 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.695528 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.698678 (+ 3150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.707870 (+ 9192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.709133 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.709292 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.709392 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.711388 (+ 1996us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.711546 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 19:27:46.713757 20594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bd6b42dc5141dcac1ea7061bfa74d3" candidate_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f47e4848414096a85d6353fa7ce9da" is_pre_election: true
I20260806 19:27:46.714048 20594 raft_consensus.cc:2454] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a0ee1ebcc91467f97fe2885cc7489a1 in term 0.
I20260806 19:27:46.714749 20283 leader_election.cc:302] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0ee1ebcc91467f97fe2885cc7489a1, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:46.715286 20692 raft_consensus.cc:2781] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:46.715399 20692 raft_consensus.cc:482] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:46.715488 20692 raft_consensus.cc:3037] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.717504 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.695219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:54079 (local address 127.17.18.65:34949)
0806 19:27:46.695420 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.695425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.709577 (+ 14152us) server_negotiation.cc:407] Connection header received
0806 19:27:46.709879 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.709885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.709968 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.710032 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:27:46.710924 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.712043 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.714726 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.716114 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.716266 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.716348 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.717007 (+ 659us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.717166 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:27:46.718292 20756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.694856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.17.18.66:54079)
0806 19:27:46.709479 (+ 14623us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.709500 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.709710 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.710232 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.710237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.710321 (+ 84us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:27:46.710725 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.710740 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.712585 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.712590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.714510 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.714526 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.716567 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.716573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.716792 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.716828 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.717776 (+ 948us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.717937 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14412,"thread_start_us":14160,"threads_started":1}
I20260806 19:27:46.719030 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bd6b42dc5141dcac1ea7061bfa74d3" candidate_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7" is_pre_election: true
I20260806 19:27:46.719058 20692 raft_consensus.cc:504] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.719316 20183 raft_consensus.cc:2454] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a0ee1ebcc91467f97fe2885cc7489a1 in term 0.
I20260806 19:27:46.720541 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bd6b42dc5141dcac1ea7061bfa74d3" candidate_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7"
I20260806 19:27:46.720896 20183 raft_consensus.cc:3037] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.721582 20594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6bd6b42dc5141dcac1ea7061bfa74d3" candidate_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88f47e4848414096a85d6353fa7ce9da"
I20260806 19:27:46.721848 20594 raft_consensus.cc:3037] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:46.724936 20594 raft_consensus.cc:2454] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a0ee1ebcc91467f97fe2885cc7489a1 in term 1.
I20260806 19:27:46.725610 20283 leader_election.cc:302] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0ee1ebcc91467f97fe2885cc7489a1, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:46.726140 20692 leader_election.cc:288] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [CANDIDATE]: Term 1 election: Requested vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423)
I20260806 19:27:46.726459 20692 raft_consensus.cc:2781] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:46.726826 20183 raft_consensus.cc:2454] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a0ee1ebcc91467f97fe2885cc7489a1 in term 1.
I20260806 19:27:46.727075 20692 raft_consensus.cc:686] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 LEADER]: Becoming Leader. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Running, Role: LEADER
I20260806 19:27:46.727718 20692 consensus_queue.cc:237] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:46.741991 19957 catalog_manager.cc:5495] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66). New cstate: current_term: 1 leader_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } health_report { overall_health: UNKNOWN } } }
I20260806 19:27:46.747102 20747 ts_tablet_manager.cc:1918] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:46.747309 20747 log.cc:1196] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/308c3ace2bff4f1697810848322eb13d
I20260806 19:27:46.747853 20747 ts_tablet_manager.cc:1939] T 308c3ace2bff4f1697810848322eb13d P 88f47e4848414096a85d6353fa7ce9da: Deleting consensus metadata
I20260806 19:27:46.749439 19930 catalog_manager.cc:4841] TS 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423): tablet 308c3ace2bff4f1697810848322eb13d (table test-table [id=b598833623ee419bb0dbd8e799631880]) successfully deleted
I20260806 19:27:46.791146 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.785579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.17.18.66:33247)
0806 19:27:46.785754 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.785760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.785820 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:27:46.786076 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.786082 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.786175 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.786319 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.786726 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.787454 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.788756 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.789233 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.789347 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.789812 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.790443 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.790594 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.790711 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.790849 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:27:46.813629 20681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.802165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35245 (local address 127.17.18.65:34949)
0806 19:27:46.802371 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.802379 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.808201 (+ 5822us) server_negotiation.cc:407] Connection header received
0806 19:27:46.808414 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.808418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.808516 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.808616 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.809248 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.810113 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.811701 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.812176 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.812301 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.812803 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.812932 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.813011 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.813171 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.813260 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 19:27:46.813949 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.802058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34949 (local address 127.17.18.66:35245)
0806 19:27:46.808038 (+ 5980us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.808060 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.808262 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.808777 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.808781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.808792 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:46.809046 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.809054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.810273 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.810277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.811532 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.811549 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.812384 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.812390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.812527 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.812605 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.813039 (+ 434us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.813051 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.813132 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.813303 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5778,"thread_start_us":5612,"threads_started":1}
I20260806 19:27:46.826381 20594 raft_consensus.cc:1261] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Refusing update from remote peer 3a0ee1ebcc91467f97fe2885cc7489a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.826603 20183 raft_consensus.cc:1261] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Refusing update from remote peer 3a0ee1ebcc91467f97fe2885cc7489a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:46.827414 20757 consensus_queue.cc:1035] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:46.827913 20692 consensus_queue.cc:1035] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:46.834326 20720 mvcc.cc:205] Tried to move back new op lower bound from 7315638136113885184 to 7315638135722799104. Current Snapshot: MvccSnapshot[applied={T|T < 7315638136113885184}]
I20260806 19:27:46.867620 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.860668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33247 (local address 127.17.18.65:33953)
0806 19:27:46.860967 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:46.860984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:46.861077 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:46.861855 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:46.861860 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:46.861874 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:27:46.862090 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.862104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.863969 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.863975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.865113 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:46.865127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.866212 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.866217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:46.866433 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.866485 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.867002 (+ 517us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.867015 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 19:27:46.867103 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:27:46.867277 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260806 19:27:46.868355 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:46.861372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:33953 (local address 127.17.18.66:33247)
0806 19:27:46.861558 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:46.861562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:46.861578 (+ 16us) server_negotiation.cc:407] Connection header received
0806 19:27:46.861634 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:46.861637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:46.861708 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:46.861799 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:46.862288 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.863326 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.865299 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:46.865971 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:46.866093 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:46.866698 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:46.866865 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:46.866947 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:46.868073 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0806 19:27:46.868147 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 19:27:46.869825 20720 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 19:27:48.500801 19960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:48.501235 19960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:48.508615 19960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Sending DeleteTablet for 3 replicas of tablet e6bd6b42dc5141dcac1ea7061bfa74d3
I20260806 19:27:48.509682 20555 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:48 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39826
I20260806 19:27:48.509738 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:48 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:36682
I20260806 19:27:48.509868 20350 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bd6b42dc5141dcac1ea7061bfa74d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:48 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:34440
I20260806 19:27:48.512136 20814 tablet_replica.cc:330] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: stopping tablet replica
I20260806 19:27:48.512462 20814 raft_consensus.cc:2229] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:48.518385 20813 tablet_replica.cc:330] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: stopping tablet replica
I20260806 19:27:48.518824 20813 raft_consensus.cc:2229] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:48.519445 20813 raft_consensus.cc:2258] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:48.513351 20814 raft_consensus.cc:2258] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:48.521524 20812 tablet_replica.cc:330] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: stopping tablet replica
I20260806 19:27:48.521879 20812 raft_consensus.cc:2229] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:48.521908 20813 ts_tablet_manager.cc:1905] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:48.522354 20812 raft_consensus.cc:2258] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:48.523470 20814 ts_tablet_manager.cc:1905] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:48.524760 20812 ts_tablet_manager.cc:1905] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:48.531891 20813 ts_tablet_manager.cc:1918] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:48.531916 20812 ts_tablet_manager.cc:1918] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:48.532161 20813 log.cc:1196] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/e6bd6b42dc5141dcac1ea7061bfa74d3
I20260806 19:27:48.532186 20812 log.cc:1196] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/e6bd6b42dc5141dcac1ea7061bfa74d3
I20260806 19:27:48.532881 20813 ts_tablet_manager.cc:1939] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting consensus metadata
I20260806 19:27:48.532883 20812 ts_tablet_manager.cc:1939] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 88f47e4848414096a85d6353fa7ce9da: Deleting consensus metadata
I20260806 19:27:48.533696 20814 ts_tablet_manager.cc:1918] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:48.533936 20814 log.cc:1196] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/e6bd6b42dc5141dcac1ea7061bfa74d3
I20260806 19:27:48.534278 19933 catalog_manager.cc:4841] TS 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949): tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (table test-table [id=3921754b035e41a39ee2f4aa0372529f]) successfully deleted
I20260806 19:27:48.534276 19930 catalog_manager.cc:4841] TS 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423): tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (table test-table [id=3921754b035e41a39ee2f4aa0372529f]) successfully deleted
I20260806 19:27:48.534739 20814 ts_tablet_manager.cc:1939] T e6bd6b42dc5141dcac1ea7061bfa74d3 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting consensus metadata
I20260806 19:27:48.536034 19933 catalog_manager.cc:4841] TS 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247): tablet e6bd6b42dc5141dcac1ea7061bfa74d3 (table test-table [id=3921754b035e41a39ee2f4aa0372529f]) successfully deleted
Aug 06 19:27:48 dist-test-slave-f0tn krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044468, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 19:27:48 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044468, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:48.606845 20823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:48.587315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50880 (local address 127.17.18.126:45391)
0806 19:27:48.588246 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:48.588251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:48.588278 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:27:48.588339 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:48.588344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:48.588409 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:48.588509 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:48.590184 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:48.591112 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:48.592611 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:48.593122 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:48.593266 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:48.599911 (+ 6645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:48.599918 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:48.599922 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:48.599971 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:48.602894 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:48.604235 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:48.604242 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:48.604244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:48.604435 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:48.605123 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:48.605128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:48.605130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:48.605546 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:48.605771 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:48.606269 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 19:27:48.606480 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":541,"threads_started":1}
I20260806 19:27:48.611625 19960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:48.612331 19960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:48.620385 20350 tablet_service.cc:1467] Processing CreateTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 (DEFAULT_TABLE table=test-table [id=05ce421f6b77425788eee8dc8360722d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:48.620724 20555 tablet_service.cc:1467] Processing CreateTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 (DEFAULT_TABLE table=test-table [id=05ce421f6b77425788eee8dc8360722d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:48.620889 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fde3ded87c440a8969548cb12c7aac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:48.621193 20555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fde3ded87c440a8969548cb12c7aac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:48.625483 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 (DEFAULT_TABLE table=test-table [id=05ce421f6b77425788eee8dc8360722d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:48.626025 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fde3ded87c440a8969548cb12c7aac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:48.630425 20824 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Bootstrap starting.
I20260806 19:27:48.631585 20825 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Bootstrap starting.
I20260806 19:27:48.633845 20826 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Bootstrap starting.
I20260806 19:27:48.635422 20824 tablet_bootstrap.cc:654] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:48.636281 20825 tablet_bootstrap.cc:654] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:48.637789 20826 tablet_bootstrap.cc:654] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:48.639495 20824 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: No bootstrap required, opened a new log
I20260806 19:27:48.639815 20824 ts_tablet_manager.cc:1397] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260806 19:27:48.640273 20825 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: No bootstrap required, opened a new log
I20260806 19:27:48.640439 20825 ts_tablet_manager.cc:1397] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260806 19:27:48.641297 20825 raft_consensus.cc:348] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.641611 20825 raft_consensus.cc:374] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:48.641733 20825 raft_consensus.cc:729] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Initialized, Role: FOLLOWER
I20260806 19:27:48.641981 20825 consensus_queue.cc:260] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.641911 20824 raft_consensus.cc:348] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.642457 20824 raft_consensus.cc:374] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:48.642563 20825 ts_tablet_manager.cc:1428] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 19:27:48.642815 20824 raft_consensus.cc:729] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Initialized, Role: FOLLOWER
I20260806 19:27:48.643489 20826 tablet_bootstrap.cc:492] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: No bootstrap required, opened a new log
I20260806 19:27:48.643311 20824 consensus_queue.cc:260] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.643661 20826 ts_tablet_manager.cc:1397] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260806 19:27:48.644546 20826 raft_consensus.cc:348] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.644835 20826 raft_consensus.cc:374] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:48.644971 20826 raft_consensus.cc:729] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Initialized, Role: FOLLOWER
I20260806 19:27:48.645216 20824 ts_tablet_manager.cc:1428] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260806 19:27:48.645426 20826 consensus_queue.cc:260] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:48.646219 20826 ts_tablet_manager.cc:1428] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260806 19:27:49.014719 20832 raft_consensus.cc:482] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:49.014982 20832 raft_consensus.cc:504] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.015705 20832 leader_election.cc:288] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247)
I20260806 19:27:49.016436 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fde3ded87c440a8969548cb12c7aac4" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7" is_pre_election: true
I20260806 19:27:49.016750 20183 raft_consensus.cc:2454] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:49.016763 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fde3ded87c440a8969548cb12c7aac4" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" is_pre_election: true
I20260806 19:27:49.017127 20379 raft_consensus.cc:2454] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:49.017357 20484 leader_election.cc:302] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e11ccf530544b58a7ab4dc009d073e7, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:49.017711 20832 raft_consensus.cc:2781] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:49.017854 20832 raft_consensus.cc:482] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:49.017966 20832 raft_consensus.cc:3037] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.020709 20832 raft_consensus.cc:504] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.021539 20832 leader_election.cc:288] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Requested vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247)
I20260806 19:27:49.022121 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fde3ded87c440a8969548cb12c7aac4" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7"
I20260806 19:27:49.022315 20183 raft_consensus.cc:3037] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.022398 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fde3ded87c440a8969548cb12c7aac4" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
I20260806 19:27:49.022730 20379 raft_consensus.cc:3037] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.024564 20183 raft_consensus.cc:2454] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:49.025110 20484 leader_election.cc:302] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e11ccf530544b58a7ab4dc009d073e7, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:49.025460 20832 raft_consensus.cc:2781] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:49.026347 20832 raft_consensus.cc:686] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Becoming Leader. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Running, Role: LEADER
I20260806 19:27:49.026575 20379 raft_consensus.cc:2454] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:49.026789 20832 consensus_queue.cc:237] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.030112 19956 catalog_manager.cc:5495] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da reported cstate change: term changed from 0 to 1, leader changed from <none> to 88f47e4848414096a85d6353fa7ce9da (127.17.18.67). New cstate: current_term: 1 leader_uuid: "88f47e4848414096a85d6353fa7ce9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } health_report { overall_health: HEALTHY } } }
I20260806 19:27:49.118748 20848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:49.106840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39834 (local address 127.17.18.67:38423)
0806 19:27:49.108392 (+ 1552us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:49.108396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:49.109782 (+ 1386us) server_negotiation.cc:407] Connection header received
0806 19:27:49.110027 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:49.110032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:49.110113 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:49.110208 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:27:49.111432 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:49.112742 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:49.115272 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:49.116229 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:49.116393 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:49.117294 (+ 901us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:27:49.117529 (+ 235us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:27:49.117617 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:49.117798 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 19:27:49.117878 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1368,"thread_start_us":1077,"threads_started":1}
I20260806 19:27:49.131210 20379 raft_consensus.cc:1261] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:49.131210 20183 raft_consensus.cc:1261] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:49.131912 20833 consensus_queue.cc:1035] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:49.132498 20832 consensus_queue.cc:1035] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:49.194962 19956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:49.195366 19956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:49.199183 19956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Sending DeleteTablet for 3 replicas of tablet 4fde3ded87c440a8969548cb12c7aac4
I20260806 19:27:49.200383 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:49 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:36682
I20260806 19:27:49.200387 20350 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:49 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:34440
I20260806 19:27:49.200572 20555 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fde3ded87c440a8969548cb12c7aac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:49 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39826
I20260806 19:27:49.202296 19956 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:27:49.203431 19956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:27:49.206475 20861 tablet_replica.cc:330] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: stopping tablet replica
I20260806 19:27:49.206924 20861 raft_consensus.cc:2229] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:49.207255 20858 tablet_replica.cc:330] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: stopping tablet replica
I20260806 19:27:49.207568 20858 raft_consensus.cc:2229] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:49.207727 20861 raft_consensus.cc:2258] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:49.207835 20858 raft_consensus.cc:2258] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:49.209084 20858 ts_tablet_manager.cc:1905] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:49.209084 20861 ts_tablet_manager.cc:1905] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:49.213546 20554 tablet_service.cc:1467] Processing CreateTablet for tablet 46ddca274f9e402ca782be76450db91c (DEFAULT_TABLE table=test-table [id=6cac647a54b240eca5802af1b37fbac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:49.214126 20554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ddca274f9e402ca782be76450db91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:49.217679 20858 ts_tablet_manager.cc:1918] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:49.217865 20858 log.cc:1196] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/4fde3ded87c440a8969548cb12c7aac4
I20260806 19:27:49.218092 20861 ts_tablet_manager.cc:1918] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:49.218515 20858 ts_tablet_manager.cc:1939] T 4fde3ded87c440a8969548cb12c7aac4 P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting consensus metadata
I20260806 19:27:49.218520 20861 log.cc:1196] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/4fde3ded87c440a8969548cb12c7aac4
I20260806 19:27:49.219573 20861 ts_tablet_manager.cc:1939] T 4fde3ded87c440a8969548cb12c7aac4 P 6e11ccf530544b58a7ab4dc009d073e7: Deleting consensus metadata
I20260806 19:27:49.221058 20862 tablet_replica.cc:330] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: stopping tablet replica
I20260806 19:27:49.220979 19933 catalog_manager.cc:4841] TS 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247): tablet 4fde3ded87c440a8969548cb12c7aac4 (table test-table [id=05ce421f6b77425788eee8dc8360722d]) successfully deleted
I20260806 19:27:49.221431 19933 catalog_manager.cc:4841] TS 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949): tablet 4fde3ded87c440a8969548cb12c7aac4 (table test-table [id=05ce421f6b77425788eee8dc8360722d]) successfully deleted
I20260806 19:27:49.221464 20862 raft_consensus.cc:2229] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:49.221937 20155 tablet_service.cc:1467] Processing CreateTablet for tablet 46ddca274f9e402ca782be76450db91c (DEFAULT_TABLE table=test-table [id=6cac647a54b240eca5802af1b37fbac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:49.222193 20862 raft_consensus.cc:2258] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:49.222684 20155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ddca274f9e402ca782be76450db91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:49.222626 20350 tablet_service.cc:1467] Processing CreateTablet for tablet 46ddca274f9e402ca782be76450db91c (DEFAULT_TABLE table=test-table [id=6cac647a54b240eca5802af1b37fbac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:27:49.223413 20350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ddca274f9e402ca782be76450db91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:49.225322 20863 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Bootstrap starting.
I20260806 19:27:49.226395 20862 ts_tablet_manager.cc:1905] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:49.232751 20863 tablet_bootstrap.cc:654] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:49.238507 20862 ts_tablet_manager.cc:1918] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:27:49.239148 20862 log.cc:1196] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/4fde3ded87c440a8969548cb12c7aac4
I20260806 19:27:49.240521 20862 ts_tablet_manager.cc:1939] T 4fde3ded87c440a8969548cb12c7aac4 P 88f47e4848414096a85d6353fa7ce9da: Deleting consensus metadata
I20260806 19:27:49.240896 20865 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Bootstrap starting.
I20260806 19:27:49.242038 20864 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Bootstrap starting.
I20260806 19:27:49.242102 19930 catalog_manager.cc:4841] TS 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423): tablet 4fde3ded87c440a8969548cb12c7aac4 (table test-table [id=05ce421f6b77425788eee8dc8360722d]) successfully deleted
I20260806 19:27:49.245886 20865 tablet_bootstrap.cc:654] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:49.246702 20864 tablet_bootstrap.cc:654] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:49.250926 20863 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: No bootstrap required, opened a new log
I20260806 19:27:49.251328 20863 ts_tablet_manager.cc:1397] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.012s
I20260806 19:27:49.253165 20863 raft_consensus.cc:348] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.254169 20863 raft_consensus.cc:374] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:49.254442 20863 raft_consensus.cc:729] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Initialized, Role: FOLLOWER
I20260806 19:27:49.254947 20863 consensus_queue.cc:260] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.256057 20863 ts_tablet_manager.cc:1428] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260806 19:27:49.258456 20864 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: No bootstrap required, opened a new log
I20260806 19:27:49.258756 20864 ts_tablet_manager.cc:1397] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.005s
I20260806 19:27:49.260277 20865 tablet_bootstrap.cc:492] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: No bootstrap required, opened a new log
I20260806 19:27:49.260632 20865 ts_tablet_manager.cc:1397] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.004s
I20260806 19:27:49.260660 20864 raft_consensus.cc:348] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.261173 20864 raft_consensus.cc:374] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:49.261456 20864 raft_consensus.cc:729] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0ee1ebcc91467f97fe2885cc7489a1, State: Initialized, Role: FOLLOWER
I20260806 19:27:49.261898 20864 consensus_queue.cc:260] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.262265 20865 raft_consensus.cc:348] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.262686 20865 raft_consensus.cc:374] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:49.262816 20864 ts_tablet_manager.cc:1428] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260806 19:27:49.263089 20865 raft_consensus.cc:729] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11ccf530544b58a7ab4dc009d073e7, State: Initialized, Role: FOLLOWER
I20260806 19:27:49.263523 20865 consensus_queue.cc:260] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.264356 20865 ts_tablet_manager.cc:1428] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 19:27:49.337827 20833 raft_consensus.cc:482] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:27:49.338248 20833 raft_consensus.cc:504] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.339275 20833 leader_election.cc:288] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247)
I20260806 19:27:49.340274 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ddca274f9e402ca782be76450db91c" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7" is_pre_election: true
I20260806 19:27:49.340428 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ddca274f9e402ca782be76450db91c" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" is_pre_election: true
I20260806 19:27:49.340613 20183 raft_consensus.cc:2454] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:49.340862 20379 raft_consensus.cc:2454] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 0.
I20260806 19:27:49.341251 20484 leader_election.cc:302] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e11ccf530544b58a7ab4dc009d073e7, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:49.341869 20833 raft_consensus.cc:2781] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:27:49.342074 20833 raft_consensus.cc:482] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:27:49.342344 20833 raft_consensus.cc:3037] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.346439 20833 raft_consensus.cc:504] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.347440 20833 leader_election.cc:288] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Requested vote from peers 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949), 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247)
I20260806 19:27:49.348218 20379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ddca274f9e402ca782be76450db91c" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1"
I20260806 19:27:49.348132 20183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ddca274f9e402ca782be76450db91c" candidate_uuid: "88f47e4848414096a85d6353fa7ce9da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e11ccf530544b58a7ab4dc009d073e7"
I20260806 19:27:49.348508 20379 raft_consensus.cc:3037] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.348521 20183 raft_consensus.cc:3037] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:49.351962 20379 raft_consensus.cc:2454] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:49.352006 20183 raft_consensus.cc:2454] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f47e4848414096a85d6353fa7ce9da in term 1.
I20260806 19:27:49.352581 20484 leader_election.cc:302] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0ee1ebcc91467f97fe2885cc7489a1, 88f47e4848414096a85d6353fa7ce9da; no voters:
I20260806 19:27:49.352947 20833 raft_consensus.cc:2781] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:49.353248 20833 raft_consensus.cc:686] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Becoming Leader. State: Replica: 88f47e4848414096a85d6353fa7ce9da, State: Running, Role: LEADER
I20260806 19:27:49.353670 20833 consensus_queue.cc:237] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } }
I20260806 19:27:49.357641 19957 catalog_manager.cc:5495] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da reported cstate change: term changed from 0 to 1, leader changed from <none> to 88f47e4848414096a85d6353fa7ce9da (127.17.18.67). New cstate: current_term: 1 leader_uuid: "88f47e4848414096a85d6353fa7ce9da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88f47e4848414096a85d6353fa7ce9da" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38423 } health_report { overall_health: HEALTHY } } }
I20260806 19:27:49.402884 20379 raft_consensus.cc:1261] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:49.402988 20183 raft_consensus.cc:1261] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Refusing update from remote peer 88f47e4848414096a85d6353fa7ce9da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:27:49.403621 20833 consensus_queue.cc:1035] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0ee1ebcc91467f97fe2885cc7489a1" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:27:49.404064 20854 consensus_queue.cc:1035] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e11ccf530544b58a7ab4dc009d073e7" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:27:49.430050 20841 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 19:27:51.031627 19956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:51.031889 19956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50880:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:27:51.038084 19956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0f70db13f01649d9bf483e6f69826b0b: Sending DeleteTablet for 3 replicas of tablet 46ddca274f9e402ca782be76450db91c
I20260806 19:27:51.039428 20350 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ddca274f9e402ca782be76450db91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:51 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:34440
I20260806 19:27:51.039448 20155 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ddca274f9e402ca782be76450db91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:51 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:36682
I20260806 19:27:51.040174 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20061
I20260806 19:27:51.041702 20554 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ddca274f9e402ca782be76450db91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:27:51 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39826
I20260806 19:27:51.051020 20915 tablet_replica.cc:330] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: stopping tablet replica
I20260806 19:27:51.051299 20915 raft_consensus.cc:2229] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:51.051680 20915 raft_consensus.cc:2258] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:51.053313 20915 ts_tablet_manager.cc:1905] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:51.057742 20920 tablet_replica.cc:330] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: stopping tablet replica
I20260806 19:27:51.058238 20920 raft_consensus.cc:2229] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:27:51.058888 20920 raft_consensus.cc:2258] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:51.061306 20920 ts_tablet_manager.cc:1905] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:51.061527 20914 tablet_replica.cc:330] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: stopping tablet replica
I20260806 19:27:51.061846 20914 raft_consensus.cc:2229] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:27:51.062337 20915 ts_tablet_manager.cc:1918] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:51.062348 20914 raft_consensus.cc:2258] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:27:51.062709 20915 log.cc:1196] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/46ddca274f9e402ca782be76450db91c
I20260806 19:27:51.063539 20914 ts_tablet_manager.cc:1905] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:27:51.063747 20915 ts_tablet_manager.cc:1939] T 46ddca274f9e402ca782be76450db91c P 6e11ccf530544b58a7ab4dc009d073e7: Deleting consensus metadata
I20260806 19:27:51.065140 19933 catalog_manager.cc:4841] TS 6e11ccf530544b58a7ab4dc009d073e7 (127.17.18.65:34949): tablet 46ddca274f9e402ca782be76450db91c (table test-table [id=6cac647a54b240eca5802af1b37fbac8]) successfully deleted
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044468, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:27:51.072913 20914 ts_tablet_manager.cc:1918] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:51.073205 20914 log.cc:1196] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/46ddca274f9e402ca782be76450db91c
I20260806 19:27:51.074106 20914 ts_tablet_manager.cc:1939] T 46ddca274f9e402ca782be76450db91c P 3a0ee1ebcc91467f97fe2885cc7489a1: Deleting consensus metadata
I20260806 19:27:51.075456 19933 catalog_manager.cc:4841] TS 3a0ee1ebcc91467f97fe2885cc7489a1 (127.17.18.66:33247): tablet 46ddca274f9e402ca782be76450db91c (table test-table [id=6cac647a54b240eca5802af1b37fbac8]) successfully deleted
I20260806 19:27:51.076128 20920 ts_tablet_manager.cc:1918] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 19:27:51.076337 20920 log.cc:1196] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/46ddca274f9e402ca782be76450db91c
I20260806 19:27:51.077170 20920 ts_tablet_manager.cc:1939] T 46ddca274f9e402ca782be76450db91c P 88f47e4848414096a85d6353fa7ce9da: Deleting consensus metadata
I20260806 19:27:51.078670 19930 catalog_manager.cc:4841] TS 88f47e4848414096a85d6353fa7ce9da (127.17.18.67:38423): tablet 46ddca274f9e402ca782be76450db91c (table test-table [id=6cac647a54b240eca5802af1b37fbac8]) successfully deleted
I20260806 19:27:51.082296 20919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:51.041784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.17.18.65:34949)
0806 19:27:51.052488 (+ 10704us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:51.052494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:51.052600 (+ 106us) server_negotiation.cc:407] Connection header received
0806 19:27:51.052678 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:51.052683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:51.052824 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:51.052957 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:51.056599 (+ 3642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.058386 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.061063 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.062291 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.062492 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:51.070983 (+ 8491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:51.071011 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:51.071039 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:51.071100 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:51.078359 (+ 7259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.079337 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.079347 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.079349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.079542 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.080059 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.080063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.080066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.080552 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:51.081014 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:51.081247 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 19:27:51.081646 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10510,"thread_start_us":10360,"threads_started":1}
W20260806 19:27:51.083423 20246 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36712
W20260806 19:27:51.084764 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20061: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:51.085090 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 20061
I20260806 19:27:51.128793 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20261
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044468, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:27:51.147226 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:51.129821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34446 (local address 127.17.18.66:33247)
0806 19:27:51.130893 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:51.130899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:51.130918 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:27:51.130978 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:51.130983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:51.131059 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:51.131164 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:51.132752 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.134016 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.135438 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.135917 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.136055 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:51.140780 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:51.140799 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:51.140818 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:51.140870 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:51.144063 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.144900 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.144909 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.144912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.145080 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.145534 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.145538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.145540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.145964 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:51.146265 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:51.146625 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 19:27:51.146874 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":904,"thread_start_us":691,"threads_started":1}
W20260806 19:27:51.147959 20442 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34446
W20260806 19:27:51.148871 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20261: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:51.149071 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 20261
I20260806 19:27:51.184154 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20451
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044468, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:27:51.202571 20926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:51.185248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39838 (local address 127.17.18.67:38423)
0806 19:27:51.185891 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:51.185896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:51.185914 (+ 18us) server_negotiation.cc:407] Connection header received
0806 19:27:51.185972 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:51.185976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:51.186040 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:51.186147 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:51.187645 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.188414 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.190082 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:51.190527 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:51.190646 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:51.195886 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:51.195906 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:51.195927 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:51.195975 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:51.199173 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.200103 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.200113 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.200115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.200294 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:51.200829 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:51.200834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:51.200836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:51.201312 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:51.201766 (+ 454us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:51.202026 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 19:27:51.202270 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":353,"threads_started":1}
W20260806 19:27:51.203516 20648 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39838
W20260806 19:27:51.204365 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20451: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:27:51.204566 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 20451
I20260806 19:27:51.243916 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 19910
I20260806 19:27:51.245273 20019 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:51.366801 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 19910
2026-08-06T19:27:51Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9089 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[20930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[20930](info): set up 2 sockets
Aug 06 19:27:51 dist-test-slave-f0tn krb5kdc[20930](info): commencing operation
krb5kdc: starting...
W20260806 19:27:52.602646 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:52 dist-test-slave-f0tn krb5kdc[20930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:52.838653 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34387
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:34387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:53.368647 20950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:53.369141 20950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:53.369429 20950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:53.381482 20950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:53.381758 20950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:53.381915 20950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:53.382087 20950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:53.382218 20950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:53.399398 20950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:34387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:53.401279 20950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:53.403868 20950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:53.423554 20962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:53.423835 20965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:53.423580 20963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:53.425154 20950 server_base.cc:1034] running on GCE node
I20260806 19:27:53.426115 20950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:53.428076 20950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:53.429461 20950 hybrid_clock.cc:648] HybridClock initialized: now 1786044473429293 us; error 30 us; skew 500 ppm
I20260806 19:27:53.430007 20950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:53 dist-test-slave-f0tn krb5kdc[20930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044473, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:53.433970 20950 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:53.435781 20950 webserver.cc:460] Webserver started at http://127.17.18.126:44933/ using document root <none> and password file <none>
I20260806 19:27:53.436566 20950 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:53.436702 20950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:53.437045 20950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:53.440475 20950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "2ba0b072cda2419b96a823a75b463f19"
format_stamp: "Formatted at 2026-08-06 19:27:53 on dist-test-slave-f0tn"
server_key: "922ad283bb08ab39d3b8bb54833f3fc9"
server_key_iv: "5871bd01300a3bd030ead47b1f1def21"
server_key_version: "encryptionkey@0"
I20260806 19:27:53.441350 20950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "2ba0b072cda2419b96a823a75b463f19"
format_stamp: "Formatted at 2026-08-06 19:27:53 on dist-test-slave-f0tn"
server_key: "922ad283bb08ab39d3b8bb54833f3fc9"
server_key_iv: "5871bd01300a3bd030ead47b1f1def21"
server_key_version: "encryptionkey@0"
I20260806 19:27:53.447341 20950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:27:53.451263 20976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:53.452802 20950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 19:27:53.453013 20950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "2ba0b072cda2419b96a823a75b463f19"
format_stamp: "Formatted at 2026-08-06 19:27:53 on dist-test-slave-f0tn"
server_key: "922ad283bb08ab39d3b8bb54833f3fc9"
server_key_iv: "5871bd01300a3bd030ead47b1f1def21"
server_key_version: "encryptionkey@0"
I20260806 19:27:53.453255 20950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:53.476460 20950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:53.481424 20950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:53.481766 20950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:53.502990 20950 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:34387
I20260806 19:27:53.503034 21062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:34387 every 8 connection(s)
I20260806 19:27:53.504473 20950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:53.508833 21063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:27:53.508805 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 20950
I20260806 19:27:53.509040 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:53.509948 17481 external_mini_cluster.cc:1428] Setting key b800f8a991228113f992917ea91515e3
I20260806 19:27:53.527472 21063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19: Bootstrap starting.
Aug 06 19:27:53 dist-test-slave-f0tn krb5kdc[20930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:53.531764 21063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:53.533546 21063 log.cc:824] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:53.537981 21063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19: No bootstrap required, opened a new log
I20260806 19:27:53.541671 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:53.512565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60498 (local address 127.17.18.126:34387)
0806 19:27:53.514206 (+ 1641us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:53.514223 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:53.514274 (+ 51us) server_negotiation.cc:407] Connection header received
0806 19:27:53.516756 (+ 2482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:53.516793 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:53.517449 (+ 656us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:53.517950 (+ 501us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:53.519735 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:53.521796 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:53.523707 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:53.524954 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:53.525216 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:53.530984 (+ 5768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:53.530996 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:53.531032 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:53.531091 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:53.535612 (+ 4521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:53.536638 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:53.536648 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:53.536658 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:53.536903 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:53.537517 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:53.537524 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:53.537527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:53.538354 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:53.539591 (+ 1237us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:53.539909 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 19:27:53.540394 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1320,"thread_start_us":1003,"threads_started":1}
I20260806 19:27:53.548919 21063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } }
I20260806 19:27:53.549353 21063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:53.549475 21063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba0b072cda2419b96a823a75b463f19, State: Initialized, Role: FOLLOWER
I20260806 19:27:53.550050 21063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } }
I20260806 19:27:53.550292 21063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:53.550434 21063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:53.550638 21063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:53.553133 21063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } }
I20260806 19:27:53.553759 21063 leader_election.cc:302] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ba0b072cda2419b96a823a75b463f19; no voters:
I20260806 19:27:53.554378 21063 leader_election.cc:288] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:53.554538 21072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:53.555177 21072 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [term 1 LEADER]: Becoming Leader. State: Replica: 2ba0b072cda2419b96a823a75b463f19, State: Running, Role: LEADER
I20260806 19:27:53.555891 21072 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } }
I20260806 19:27:53.556722 21063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:53.559259 21073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ba0b072cda2419b96a823a75b463f19. Latest consensus state: current_term: 1 leader_uuid: "2ba0b072cda2419b96a823a75b463f19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } } }
I20260806 19:27:53.559836 21073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:53.559281 21074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ba0b072cda2419b96a823a75b463f19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba0b072cda2419b96a823a75b463f19" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34387 } } }
I20260806 19:27:53.560531 21074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:53.562026 21084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:53.568091 21084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:53.578864 21084 catalog_manager.cc:1347] Generated new cluster ID: 13a937f85aa54f678211891b6b6eaa40
I20260806 19:27:53.579025 21084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:53.600652 21084 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:53.602274 21084 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:53.611320 21084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ba0b072cda2419b96a823a75b463f19: Generated new TSK 0
I20260806 19:27:53.612241 21084 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:53.678496 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:54.078192 21099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:54.078531 21099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:54.078634 21099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:54.086295 21099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:54.086432 21099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:54.086549 21099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:27:54.097136 21099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:54.098707 21099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:54.100172 21099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:54.115139 21104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:54.115248 21105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:54.115252 21107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:54.116515 21099 server_base.cc:1034] running on GCE node
I20260806 19:27:54.117244 21099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:54.118374 21099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:54.119590 21099 hybrid_clock.cc:648] HybridClock initialized: now 1786044474119512 us; error 71 us; skew 500 ppm
I20260806 19:27:54.119925 21099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:54 dist-test-slave-f0tn krb5kdc[20930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044474, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:54.123857 21099 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:27:54.125960 21099 webserver.cc:460] Webserver started at http://127.17.18.65:43341/ using document root <none> and password file <none>
I20260806 19:27:54.126748 21099 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:54.126858 21099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:54.127153 21099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:54.130424 21099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "4915fbd836c54b36800449bfd4ffbc52"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "e971f38c1a74a91f671895c60ce87113"
server_key_iv: "c6bb604e802ffdf33b05fbde7b23eeca"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.131297 21099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "4915fbd836c54b36800449bfd4ffbc52"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "e971f38c1a74a91f671895c60ce87113"
server_key_iv: "c6bb604e802ffdf33b05fbde7b23eeca"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.137012 21099 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 19:27:54.140929 21117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:54.142771 21099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:27:54.142954 21099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "4915fbd836c54b36800449bfd4ffbc52"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "e971f38c1a74a91f671895c60ce87113"
server_key_iv: "c6bb604e802ffdf33b05fbde7b23eeca"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.143162 21099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:54.160075 21099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:54.165064 21099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:54.165400 21099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:54.166517 21099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:54.167958 21099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:54.168036 21099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:54.168129 21099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:54.168172 21099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:54.201999 21099 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:40763
I20260806 19:27:54.202035 21279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:40763 every 8 connection(s)
I20260806 19:27:54.203359 21099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:27:54.206755 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 21099
I20260806 19:27:54.206971 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:27:54.207844 17481 external_mini_cluster.cc:1428] Setting key c35bd9a6305e83354d32bfec26c25b39
Aug 06 19:27:54 dist-test-slave-f0tn krb5kdc[20930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044474, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:54.228704 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:54.206177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:44639 (local address 127.17.18.126:34387)
0806 19:27:54.206731 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:54.206738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:54.207884 (+ 1146us) server_negotiation.cc:407] Connection header received
0806 19:27:54.210230 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:54.210236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:54.210306 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:54.210396 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:54.213025 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.214018 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.216647 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.217237 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.217443 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:54.222013 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:54.222020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:54.222023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:54.222066 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:54.224996 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:54.226011 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:54.226016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:54.226018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:54.226180 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:54.226695 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:54.226700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:54.226702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:54.227014 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:54.227181 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:54.228062 (+ 881us) server_negotiation.cc:299] Negotiation successful
0806 19:27:54.228343 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":261,"threads_started":1}
I20260806 19:27:54.229866 21284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:54.206749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34387 (local address 127.17.18.65:44639)
0806 19:27:54.207666 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:54.207725 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:54.209942 (+ 2217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:54.210741 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:54.210754 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:54.211579 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:54.212687 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:54.212730 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.214252 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.214259 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:54.216357 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:54.216382 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.217589 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.217598 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:54.217924 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:54.218978 (+ 1054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:54.219117 (+ 139us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:54.221680 (+ 2563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:54.225220 (+ 3540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:54.225230 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:54.225249 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:54.225855 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:54.226315 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:54.226320 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:54.226322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:54.226556 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:54.227168 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:54.227177 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:54.227595 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 19:27:54.227875 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 19:27:54.228500 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":355,"threads_started":1}
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:27:54.231874 21280 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34387
I20260806 19:27:54.232225 21280 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:54.233346 21280 heartbeater.cc:511] Master 127.17.18.126:34387 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
I20260806 19:27:54.236555 21000 ts_manager.cc:194] Registered new tserver with Master: 4915fbd836c54b36800449bfd4ffbc52 (127.17.18.65:40763)
I20260806 19:27:54.238255 21000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:44639
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:27:54.271049 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:54.639947 21288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:54.640280 21288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:54.640380 21288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:54.648003 21288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:54.648298 21288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:54.648514 21288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:27:54.660167 21288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:54.661844 21288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:54.663319 21288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:54.677918 21298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:54.678054 21295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:54.678020 21294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:54.679227 21288 server_base.cc:1034] running on GCE node
I20260806 19:27:54.679944 21288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:54.681064 21288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:54.682323 21288 hybrid_clock.cc:648] HybridClock initialized: now 1786044474682266 us; error 43 us; skew 500 ppm
I20260806 19:27:54.682705 21288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:54 dist-test-slave-f0tn krb5kdc[20930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044474, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:54.686484 21288 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:27:54.688448 21288 webserver.cc:460] Webserver started at http://127.17.18.66:35255/ using document root <none> and password file <none>
I20260806 19:27:54.689258 21288 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:54.689422 21288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:54.689778 21288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:54.693034 21288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "7e972388d6ad4552a6edf5cdf03cab0c"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "6c1ff42aab63c0749ff3399d496efe80"
server_key_iv: "cd5bbc4ac6c689801ca3b417235cb6c4"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.694047 21288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "7e972388d6ad4552a6edf5cdf03cab0c"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "6c1ff42aab63c0749ff3399d496efe80"
server_key_iv: "cd5bbc4ac6c689801ca3b417235cb6c4"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.700207 21288 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260806 19:27:54.704367 21310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:54.706012 21288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:27:54.706213 21288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "7e972388d6ad4552a6edf5cdf03cab0c"
format_stamp: "Formatted at 2026-08-06 19:27:54 on dist-test-slave-f0tn"
server_key: "6c1ff42aab63c0749ff3399d496efe80"
server_key_iv: "cd5bbc4ac6c689801ca3b417235cb6c4"
server_key_version: "encryptionkey@0"
I20260806 19:27:54.706452 21288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:54.729650 21288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:54.734459 21288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:54.734761 21288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:54.735808 21288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:54.737428 21288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:54.737530 21288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260806 19:27:54.737661 21288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:54.737716 21288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:54.770464 21288 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:35419
I20260806 19:27:54.770520 21472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:35419 every 8 connection(s)
I20260806 19:27:54.771821 21288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:27:54.777603 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 21288
I20260806 19:27:54.777783 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:27:54.778231 17481 external_mini_cluster.cc:1428] Setting key 4635de008149ea5eb5d913b76344d4aa
Aug 06 19:27:54 dist-test-slave-f0tn krb5kdc[20930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044474, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:54.794080 21479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:54.774643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46709 (local address 127.17.18.126:34387)
0806 19:27:54.775189 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:54.775194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:54.776228 (+ 1034us) server_negotiation.cc:407] Connection header received
0806 19:27:54.778398 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:54.778405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:54.778502 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:54.778608 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:54.780551 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.781677 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.783400 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.783966 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.784105 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:54.787940 (+ 3835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:54.787947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:54.787951 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:54.788004 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:54.790618 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:54.791565 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:54.791569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:54.791571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:54.791713 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:54.792232 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:54.792235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:54.792237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:54.792516 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:54.792629 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:54.793606 (+ 977us) server_negotiation.cc:299] Negotiation successful
0806 19:27:54.793800 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":321,"threads_started":1}
I20260806 19:27:54.795558 21481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:54.775163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34387 (local address 127.17.18.66:46709)
0806 19:27:54.775995 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:54.776038 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:54.778044 (+ 2006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:54.778976 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:54.778990 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:54.779612 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:54.780319 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:54.780348 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.781878 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.781882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:54.783234 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:54.783248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:54.784242 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:54.784248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:54.784470 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:54.785235 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:54.785261 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:54.787640 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:54.790788 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:54.790799 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:54.790819 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:54.791435 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:54.791839 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:54.791844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:54.791847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:54.792124 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:54.792640 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:54.792648 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:54.793123 (+ 475us) client_negotiation.cc:769] Sending connection context
0806 19:27:54.793475 (+ 352us) client_negotiation.cc:240] Negotiation successful
0806 19:27:54.794116 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":334,"threads_started":1}
I20260806 19:27:54.797190 21475 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34387
I20260806 19:27:54.797612 21475 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:54.798641 21475 heartbeater.cc:511] Master 127.17.18.126:34387 requested a full tablet report, sending...
I20260806 19:27:54.800555 21000 ts_manager.cc:194] Registered new tserver with Master: 7e972388d6ad4552a6edf5cdf03cab0c (127.17.18.66:35419)
I20260806 19:27:54.801483 21000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:46709
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:27:54.837741 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:55.190373 21485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:55.190732 21485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:55.190860 21485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:55.198585 21485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:55.198725 21485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:55.198871 21485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:27:55.209757 21485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:34387
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:55.211416 21485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:55.213053 21485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:55.229151 21496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:55.229343 21494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:55.229617 21493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:55.230861 21485 server_base.cc:1034] running on GCE node
I20260806 19:27:55.231613 21485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:55.232728 21485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:55.233973 21485 hybrid_clock.cc:648] HybridClock initialized: now 1786044475233892 us; error 65 us; skew 500 ppm
I20260806 19:27:55.234515 21485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:55 dist-test-slave-f0tn krb5kdc[20930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044475, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:55.238443 21485 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:27:55.240243 21485 webserver.cc:460] Webserver started at http://127.17.18.67:43021/ using document root <none> and password file <none>
I20260806 19:27:55.241257 21485 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:55.241444 21485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:55.241840 21485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:55.241799 21280 heartbeater.cc:503] Master 127.17.18.126:34387 was elected leader, sending a full tablet report...
I20260806 19:27:55.246337 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "d604ef44fde2441facdc78d3254ab9eb"
format_stamp: "Formatted at 2026-08-06 19:27:55 on dist-test-slave-f0tn"
server_key: "4a7facaf162e9e20adc827527ebe7209"
server_key_iv: "944bdc2223bcfb1021d319fd49cb1e2c"
server_key_version: "encryptionkey@0"
I20260806 19:27:55.247509 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "d604ef44fde2441facdc78d3254ab9eb"
format_stamp: "Formatted at 2026-08-06 19:27:55 on dist-test-slave-f0tn"
server_key: "4a7facaf162e9e20adc827527ebe7209"
server_key_iv: "944bdc2223bcfb1021d319fd49cb1e2c"
server_key_version: "encryptionkey@0"
I20260806 19:27:55.254290 21485 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:27:55.258692 21505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:55.260330 21485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:27:55.260538 21485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "d604ef44fde2441facdc78d3254ab9eb"
format_stamp: "Formatted at 2026-08-06 19:27:55 on dist-test-slave-f0tn"
server_key: "4a7facaf162e9e20adc827527ebe7209"
server_key_iv: "944bdc2223bcfb1021d319fd49cb1e2c"
server_key_version: "encryptionkey@0"
I20260806 19:27:55.260795 21485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:55.288909 21485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:55.293316 21485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:55.293632 21485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:55.294698 21485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:27:55.296125 21485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:27:55.296207 21485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:55.296334 21485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:27:55.296391 21485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:55.327909 21485 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:41503
I20260806 19:27:55.327965 21669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:41503 every 8 connection(s)
I20260806 19:27:55.329322 21485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:27:55.332333 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 21485
I20260806 19:27:55.332507 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:27:55.333050 17481 external_mini_cluster.cc:1428] Setting key 605586853c04b40a87e20d7854945823
Aug 06 19:27:55 dist-test-slave-f0tn krb5kdc[20930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044475, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:55.351953 21675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:55.332059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:45211 (local address 127.17.18.126:34387)
0806 19:27:55.332529 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:55.332534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:55.334275 (+ 1741us) server_negotiation.cc:407] Connection header received
0806 19:27:55.336706 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:55.336710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:55.336804 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:55.336897 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:55.338613 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:55.339394 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:55.341019 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:55.341476 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:55.341598 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:55.345486 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:55.345492 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:55.345495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:55.345534 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:55.348618 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:55.349616 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:55.349622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:55.349625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:55.349782 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:55.350267 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:55.350271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:55.350273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:55.350571 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:55.350697 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:55.351465 (+ 768us) server_negotiation.cc:299] Negotiation successful
0806 19:27:55.351678 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":257,"threads_started":1}
I20260806 19:27:55.352913 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:55.332760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34387 (local address 127.17.18.67:45211)
0806 19:27:55.333740 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0806 19:27:55.333793 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 19:27:55.336266 (+ 2473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:27:55.337187 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:27:55.337197 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:27:55.337811 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:27:55.338428 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:55.338447 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:55.339558 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:55.339562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:55.340853 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:27:55.340867 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:27:55.341751 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:27:55.341759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:27:55.342000 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:55.342732 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:27:55.342759 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:27:55.345199 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:27:55.348798 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:55.348808 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:55.348825 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:55.349498 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:55.349890 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:27:55.349895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:27:55.349898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:27:55.350139 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:27:55.350676 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:27:55.350690 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:27:55.351063 (+ 373us) client_negotiation.cc:769] Sending connection context
0806 19:27:55.351318 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 19:27:55.351759 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":384,"threads_started":1}
I20260806 19:27:55.354748 21673 heartbeater.cc:347] Connected to a master server at 127.17.18.126:34387
I20260806 19:27:55.355083 21673 heartbeater.cc:464] Registering TS with master...
I20260806 19:27:55.355854 21673 heartbeater.cc:511] Master 127.17.18.126:34387 requested a full tablet report, sending...
I20260806 19:27:55.357370 21000 ts_manager.cc:194] Registered new tserver with Master: d604ef44fde2441facdc78d3254ab9eb (127.17.18.67:41503)
I20260806 19:27:55.358275 21000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:45211
I20260806 19:27:55.362830 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 19:27:55.402303 21675 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:27:55.399735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55050 (local address 127.17.18.126:34387)
0806 19:27:55.399933 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:55.399941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:55.400314 (+ 373us) server_negotiation.cc:407] Connection header received
0806 19:27:55.400496 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:55.400501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:55.400571 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:55.400669 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:55.402100 (+ 1431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55050: BlockingRecv error: recv got EOF from 127.0.0.1:55050 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 19:27:55.405624 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21099
W20260806 19:27:55.408774 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21099: Not authorized: Client connection negotiation failed: client connection to 127.17.18.65:40763: server requires authentication, but client does not have Kerberos credentials available
I20260806 19:27:55.409045 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 21099
I20260806 19:27:55.433943 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21288
W20260806 19:27:55.436866 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21288: Not authorized: Client connection negotiation failed: client connection to 127.17.18.66:35419: server requires authentication, but client does not have Kerberos credentials available
I20260806 19:27:55.437053 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 21288
I20260806 19:27:55.460765 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21485
W20260806 19:27:55.464277 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21485: Not authorized: Client connection negotiation failed: client connection to 127.17.18.67:41503: server requires authentication, but client does not have Kerberos credentials available
I20260806 19:27:55.464468 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 21485
I20260806 19:27:55.489656 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 20950
I20260806 19:27:55.490959 21055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:55.599255 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 20950
2026-08-06T19:27:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4232 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:55 dist-test-slave-f0tn krb5kdc[21696](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:55 dist-test-slave-f0tn krb5kdc[21696](info): set up 2 sockets
Aug 06 19:27:55 dist-test-slave-f0tn krb5kdc[21696](info): commencing operation
krb5kdc: starting...
W20260806 19:27:56.809341 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:56 dist-test-slave-f0tn krb5kdc[21696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:57.050448 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37139
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37139
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:57.425988 21719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:57.426345 21719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:57.426486 21719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:57.434759 21719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:57.434914 21719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:57.434974 21719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:57.435060 21719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:57.435132 21719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:57.446992 21719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:57.448532 21719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:57.450096 21719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:57.464095 21725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:57.463883 21727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:57.463934 21729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:57.465658 21719 server_base.cc:1034] running on GCE node
I20260806 19:27:57.466619 21719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:57.468415 21719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:57.469666 21719 hybrid_clock.cc:648] HybridClock initialized: now 1786044477469599 us; error 58 us; skew 500 ppm
I20260806 19:27:57.470098 21719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:57 dist-test-slave-f0tn krb5kdc[21696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044477, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:57.477758 21719 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:57.479543 21719 webserver.cc:460] Webserver started at http://127.17.18.126:37933/ using document root <none> and password file <none>
I20260806 19:27:57.480290 21719 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:57.480424 21719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:57.480747 21719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:57.484087 21719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "13861e2301c14b008d948ed2a3dd6dae"
format_stamp: "Formatted at 2026-08-06 19:27:57 on dist-test-slave-f0tn"
server_key: "bd894eddcff79f57b1ba0a518917ffa1"
server_key_iv: "fa142fd300568af8692d3ba5b8d3b879"
server_key_version: "encryptionkey@0"
I20260806 19:27:57.484957 21719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "13861e2301c14b008d948ed2a3dd6dae"
format_stamp: "Formatted at 2026-08-06 19:27:57 on dist-test-slave-f0tn"
server_key: "bd894eddcff79f57b1ba0a518917ffa1"
server_key_iv: "fa142fd300568af8692d3ba5b8d3b879"
server_key_version: "encryptionkey@0"
I20260806 19:27:57.490947 21719 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:27:57.495268 21739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:57.497314 21719 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 19:27:57.497617 21719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "13861e2301c14b008d948ed2a3dd6dae"
format_stamp: "Formatted at 2026-08-06 19:27:57 on dist-test-slave-f0tn"
server_key: "bd894eddcff79f57b1ba0a518917ffa1"
server_key_iv: "fa142fd300568af8692d3ba5b8d3b879"
server_key_version: "encryptionkey@0"
I20260806 19:27:57.497854 21719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:57.516536 21719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:57.521325 21719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:57.521684 21719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:57.542215 21719 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:37139
I20260806 19:27:57.542279 21813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:37139 every 8 connection(s)
I20260806 19:27:57.543802 21719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:57.546383 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 21719
I20260806 19:27:57.546671 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:57.547519 17481 external_mini_cluster.cc:1428] Setting key 97a364f7e5ddb57d9b90207ba33dd58b
I20260806 19:27:57.549220 21814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:27:57 dist-test-slave-f0tn krb5kdc[21696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:57.565725 21814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae: Bootstrap starting.
I20260806 19:27:57.569617 21814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:57.571094 21814 log.cc:824] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:57.574612 21814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae: No bootstrap required, opened a new log
I20260806 19:27:57.574630 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:57.549939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51590 (local address 127.17.18.126:37139)
0806 19:27:57.550914 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:57.550927 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:57.550974 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:27:57.552756 (+ 1782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:57.552789 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:57.553279 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:57.553786 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:57.555889 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:57.557453 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:57.559239 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:57.559993 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:57.560155 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:57.565887 (+ 5732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:57.565919 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:57.565941 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:57.565999 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:57.569518 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:57.570580 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:57.570589 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:57.570597 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:57.570849 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:57.571380 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:57.571386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:57.571388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:57.572102 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:57.572497 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:57.573002 (+ 505us) server_negotiation.cc:299] Negotiation successful
0806 19:27:57.573519 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":412,"threads_started":1}
I20260806 19:27:57.579131 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:27:57.583439 21814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } }
I20260806 19:27:57.583921 21814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:57.584093 21814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13861e2301c14b008d948ed2a3dd6dae, State: Initialized, Role: FOLLOWER
I20260806 19:27:57.584782 21814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } }
I20260806 19:27:57.585037 21814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:57.585180 21814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:57.585343 21814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:57.587709 21814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } }
I20260806 19:27:57.588287 21814 leader_election.cc:302] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13861e2301c14b008d948ed2a3dd6dae; no voters:
I20260806 19:27:57.589304 21814 leader_election.cc:288] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:57.589453 21825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:57.592293 21814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:57.592818 21825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [term 1 LEADER]: Becoming Leader. State: Replica: 13861e2301c14b008d948ed2a3dd6dae, State: Running, Role: LEADER
I20260806 19:27:57.593614 21825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } }
I20260806 19:27:57.596943 21827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13861e2301c14b008d948ed2a3dd6dae. Latest consensus state: current_term: 1 leader_uuid: "13861e2301c14b008d948ed2a3dd6dae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } } }
I20260806 19:27:57.598067 21827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:57.597633 21826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13861e2301c14b008d948ed2a3dd6dae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13861e2301c14b008d948ed2a3dd6dae" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37139 } } }
I20260806 19:27:57.598598 21826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:57.606616 21838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:57.612846 21838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:57.619769 21849 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 19:27:57.624298 21838 catalog_manager.cc:1347] Generated new cluster ID: 9555f914ec2144dbacd2828a67179d80
I20260806 19:27:57.624431 21838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:57.635448 21838 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:57.637185 21838 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:57.643442 21838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13861e2301c14b008d948ed2a3dd6dae: Generated new TSK 0
I20260806 19:27:57.644588 21838 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:27:57.646416 21820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:57.636237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.17.18.126:37139)
0806 19:27:57.636400 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:57.636404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:57.636502 (+ 98us) server_negotiation.cc:407] Connection header received
0806 19:27:57.636696 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:57.636702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:57.637223 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:57.637340 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:57.638998 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:57.640178 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:57.642201 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:57.642817 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:57.642956 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:57.644311 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:57.644317 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:57.644322 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:27:57.645510 (+ 1188us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:57.645594 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:27:57.645641 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:57.645765 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:57.645942 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 19:27:57.646065 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:27:57.654305 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21719
I20260806 19:27:57.656172 21807 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:27:57.747774 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 21719
2026-08-06T19:27:57Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2147 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:27:57 dist-test-slave-f0tn krb5kdc[21864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:27:57 dist-test-slave-f0tn krb5kdc[21864](info): set up 2 sockets
Aug 06 19:27:57 dist-test-slave-f0tn krb5kdc[21864](info): commencing operation
krb5kdc: starting...
W20260806 19:27:58.991468 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:27:59 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:27:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:27:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:27:59.239104 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40877
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:27:59.607120 21879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:27:59.607473 21879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:27:59.607637 21879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:27:59.615386 21879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:27:59.615530 21879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:27:59.615617 21879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:27:59.615700 21879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:27:59.615762 21879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:27:59.626972 21879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:27:59.628485 21879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:27:59.630057 21879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:27:59.642604 21889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:59.642637 21886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:27:59.642673 21885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:27:59.643508 21879 server_base.cc:1034] running on GCE node
I20260806 19:27:59.644361 21879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:27:59.645985 21879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:27:59.647250 21879 hybrid_clock.cc:648] HybridClock initialized: now 1786044479647183 us; error 55 us; skew 500 ppm
I20260806 19:27:59.647622 21879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:27:59 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044479, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:27:59.650943 21879 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:27:59.652534 21879 webserver.cc:460] Webserver started at http://127.17.18.126:40383/ using document root <none> and password file <none>
I20260806 19:27:59.653266 21879 fs_manager.cc:359] Metadata directory not provided
I20260806 19:27:59.653395 21879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:27:59.653697 21879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:27:59.656934 21879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "bdbef14507174e089028ff3691f5e130"
format_stamp: "Formatted at 2026-08-06 19:27:59 on dist-test-slave-f0tn"
server_key: "7bb27061941fc500e7c0e71c52be42da"
server_key_iv: "c5faf072696200704c7de5f6a9edf980"
server_key_version: "encryptionkey@0"
I20260806 19:27:59.657809 21879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "bdbef14507174e089028ff3691f5e130"
format_stamp: "Formatted at 2026-08-06 19:27:59 on dist-test-slave-f0tn"
server_key: "7bb27061941fc500e7c0e71c52be42da"
server_key_iv: "c5faf072696200704c7de5f6a9edf980"
server_key_version: "encryptionkey@0"
I20260806 19:27:59.663638 21879 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:27:59.667459 21899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:27:59.669106 21879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:27:59.669317 21879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "bdbef14507174e089028ff3691f5e130"
format_stamp: "Formatted at 2026-08-06 19:27:59 on dist-test-slave-f0tn"
server_key: "7bb27061941fc500e7c0e71c52be42da"
server_key_iv: "c5faf072696200704c7de5f6a9edf980"
server_key_version: "encryptionkey@0"
I20260806 19:27:59.669576 21879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:27:59.696328 21879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:27:59.700954 21879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:27:59.701233 21879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:27:59.721091 21879 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40877
I20260806 19:27:59.721150 21964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40877 every 8 connection(s)
I20260806 19:27:59.722681 21879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:27:59.725100 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 21879
I20260806 19:27:59.725425 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:27:59.726271 17481 external_mini_cluster.cc:1428] Setting key 51985a4bbe35ef2acdeacd36789468f0
I20260806 19:27:59.728236 21965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:27:59 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:27:59.746552 21965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130: Bootstrap starting.
I20260806 19:27:59.750602 21965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130: Neither blocks nor log segments found. Creating new log.
I20260806 19:27:59.752125 21965 log.cc:824] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130: Log is configured to *not* fsync() on all Append() calls
I20260806 19:27:59.756233 21965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130: No bootstrap required, opened a new log
I20260806 19:27:59.759684 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:27:59.729173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.17.18.126:40877)
0806 19:27:59.730338 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0806 19:27:59.730354 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 19:27:59.730408 (+ 54us) server_negotiation.cc:407] Connection header received
0806 19:27:59.732981 (+ 2573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:27:59.733023 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:27:59.733771 (+ 748us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:27:59.734361 (+ 590us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:27:59.736550 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:59.738881 (+ 2331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:59.741006 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:27:59.742241 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:27:59.742471 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:27:59.749720 (+ 7249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:27:59.749735 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:27:59.749759 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:27:59.749819 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:27:59.754120 (+ 4301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:59.755240 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:59.755251 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:59.755263 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:59.755515 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:27:59.756042 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:27:59.756048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:27:59.756051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:27:59.756822 (+ 771us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:27:59.757190 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0806 19:27:59.757694 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 19:27:59.758197 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":869,"thread_start_us":550,"threads_started":1}
I20260806 19:27:59.769872 21965 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } }
I20260806 19:27:59.770458 21965 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:27:59.770597 21965 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbef14507174e089028ff3691f5e130, State: Initialized, Role: FOLLOWER
I20260806 19:27:59.771391 21965 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } }
I20260806 19:27:59.771780 21965 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:27:59.771955 21965 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:27:59.772171 21965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:27:59.775866 21965 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } }
I20260806 19:27:59.776598 21965 leader_election.cc:302] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdbef14507174e089028ff3691f5e130; no voters:
I20260806 19:27:59.777420 21965 leader_election.cc:288] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:27:59.777544 21972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:27:59.778335 21972 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [term 1 LEADER]: Becoming Leader. State: Replica: bdbef14507174e089028ff3691f5e130, State: Running, Role: LEADER
I20260806 19:27:59.779002 21972 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } }
I20260806 19:27:59.780100 21965 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:27:59.785709 21974 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdbef14507174e089028ff3691f5e130. Latest consensus state: current_term: 1 leader_uuid: "bdbef14507174e089028ff3691f5e130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } } }
I20260806 19:27:59.786399 21974 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:59.790153 21973 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdbef14507174e089028ff3691f5e130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbef14507174e089028ff3691f5e130" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40877 } } }
I20260806 19:27:59.790441 21982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:27:59.790547 21973 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130 [sys.catalog]: This master's current role is: LEADER
I20260806 19:27:59.796456 21982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:27:59.809321 21982 catalog_manager.cc:1347] Generated new cluster ID: 64980964132046518e18de0794b3a196
I20260806 19:27:59.809653 21982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:27:59.824577 21982 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:27:59.826341 21982 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:27:59.836746 21982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdbef14507174e089028ff3691f5e130: Generated new TSK 0
I20260806 19:27:59.838017 21982 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:27:59.906827 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:00.287011 22005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:00.287380 22005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:00.287520 22005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:00.295629 22005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:00.295784 22005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:00.295946 22005 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:00.306562 22005 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:00.308176 22005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:00.309701 22005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:00.325268 22012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:00.325193 22013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:00.325141 22016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:00.331341 22005 server_base.cc:1034] running on GCE node
I20260806 19:28:00.332213 22005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:00.333544 22005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:00.334832 22005 hybrid_clock.cc:648] HybridClock initialized: now 1786044480334766 us; error 60 us; skew 500 ppm
I20260806 19:28:00.335274 22005 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:00 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044480, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:00.339267 22005 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:28:00.341229 22005 webserver.cc:460] Webserver started at http://127.17.18.65:33609/ using document root <none> and password file <none>
I20260806 19:28:00.342106 22005 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:00.342231 22005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:00.342567 22005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:00.346058 22005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "ec42249162ba4aceb753415eac48ef61"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "22a58ae9684e91cb5e70d85c65d8992f"
server_key_iv: "152341c306a38450f9f8ede0a5f259cf"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.346917 22005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "ec42249162ba4aceb753415eac48ef61"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "22a58ae9684e91cb5e70d85c65d8992f"
server_key_iv: "152341c306a38450f9f8ede0a5f259cf"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.353097 22005 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:28:00.358186 22031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:00.359903 22005 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:00.360220 22005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "ec42249162ba4aceb753415eac48ef61"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "22a58ae9684e91cb5e70d85c65d8992f"
server_key_iv: "152341c306a38450f9f8ede0a5f259cf"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.360476 22005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:00.385563 22005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:00.390323 22005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:00.390607 22005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:00.391667 22005 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:00.393203 22005 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:00.393290 22005 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:00.393411 22005 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:00.393457 22005 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 19:28:00.426750 22005 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:33699
I20260806 19:28:00.426939 22183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:33699 every 8 connection(s)
I20260806 19:28:00.428205 22005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:00.435108 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22005
I20260806 19:28:00.435348 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:00.435995 17481 external_mini_cluster.cc:1428] Setting key 088fa0c34264bbe1745af2764ff2b305
Aug 06 19:28:00 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044480, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:00.451431 22187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:00.430988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:49623 (local address 127.17.18.126:40877)
0806 19:28:00.431495 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:00.431501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:00.432549 (+ 1048us) server_negotiation.cc:407] Connection header received
0806 19:28:00.434616 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:00.434623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:00.434721 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:00.434866 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:00.436787 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:00.437806 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:00.440261 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:00.440669 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:00.440793 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:00.445262 (+ 4469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:00.445269 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:00.445272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:00.445313 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:00.447965 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:00.448835 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:00.448852 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:00.448855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:00.448998 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:00.449491 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:00.449497 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:00.449500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:00.449816 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:00.449965 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:00.450782 (+ 817us) server_negotiation.cc:299] Negotiation successful
0806 19:28:00.451052 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":234,"threads_started":1}
I20260806 19:28:00.452514 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:00.431533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40877 (local address 127.17.18.65:49623)
0806 19:28:00.432355 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:00.432402 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:00.434268 (+ 1866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:00.435182 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:00.435197 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:00.435854 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:00.436536 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:00.436564 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:00.438000 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:00.438004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:00.440083 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:00.440104 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:00.440956 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:00.440963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:00.441286 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:00.442140 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:00.442173 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:00.444956 (+ 2783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:00.448159 (+ 3203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:00.448171 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:00.448189 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:00.448691 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:00.449133 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:00.449138 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:00.449143 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:00.449354 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:00.449958 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:00.449967 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:00.450360 (+ 393us) client_negotiation.cc:769] Sending connection context
0806 19:28:00.450628 (+ 268us) client_negotiation.cc:240] Negotiation successful
0806 19:28:00.451251 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":309,"threads_started":1}
I20260806 19:28:00.454380 22184 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40877
I20260806 19:28:00.454795 22184 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:00.455825 22184 heartbeater.cc:511] Master 127.17.18.126:40877 requested a full tablet report, sending...
I20260806 19:28:00.458527 21918 ts_manager.cc:194] Registered new tserver with Master: ec42249162ba4aceb753415eac48ef61 (127.17.18.65:33699)
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:28:00.460183 21918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:49623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:28:00.491398 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:00.864907 22193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:00.865293 22193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:00.865469 22193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:00.872987 22193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:00.873148 22193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:00.873311 22193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:00.883791 22193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:00.885291 22193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:00.886787 22193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:00.901831 22202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:00.901746 22204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:00.901746 22200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:00.902832 22193 server_base.cc:1034] running on GCE node
I20260806 19:28:00.903630 22193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:00.904728 22193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:00.905972 22193 hybrid_clock.cc:648] HybridClock initialized: now 1786044480905900 us; error 59 us; skew 500 ppm
I20260806 19:28:00.906380 22193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:00 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044480, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:00.910108 22193 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:28:00.911818 22193 webserver.cc:460] Webserver started at http://127.17.18.66:46559/ using document root <none> and password file <none>
I20260806 19:28:00.912575 22193 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:00.912812 22193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:00.913185 22193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:00.916584 22193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "3e31430cb7ad41c1b8661213ee22025d"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "d7947f94bc644711e7e27e19d169231d"
server_key_iv: "3fb91c08983200838dae91670727ce11"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.917557 22193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "3e31430cb7ad41c1b8661213ee22025d"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "d7947f94bc644711e7e27e19d169231d"
server_key_iv: "3fb91c08983200838dae91670727ce11"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.923280 22193 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:28:00.927685 22216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:00.929698 22193 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:00.929906 22193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "3e31430cb7ad41c1b8661213ee22025d"
format_stamp: "Formatted at 2026-08-06 19:28:00 on dist-test-slave-f0tn"
server_key: "d7947f94bc644711e7e27e19d169231d"
server_key_iv: "3fb91c08983200838dae91670727ce11"
server_key_version: "encryptionkey@0"
I20260806 19:28:00.930136 22193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:00.962529 22193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:00.968222 22193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:00.968575 22193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:00.969767 22193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:00.971351 22193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:00.971442 22193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:00.971573 22193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:00.971640 22193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:01.005939 22193 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:44707
I20260806 19:28:01.005991 22375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:44707 every 8 connection(s)
I20260806 19:28:01.007416 22193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:01.007843 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22193
I20260806 19:28:01.008033 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:01.008630 17481 external_mini_cluster.cc:1428] Setting key fdbe55be964e6d3bcdc85433fb430937
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044480, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:01.034159 22379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.010372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35679 (local address 127.17.18.126:40877)
0806 19:28:01.010998 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.011006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.012354 (+ 1348us) server_negotiation.cc:407] Connection header received
0806 19:28:01.015133 (+ 2779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.015139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.015231 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.015354 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.017793 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.018770 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.021212 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.021744 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.021882 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.026291 (+ 4409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.026298 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.026301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.026345 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.029546 (+ 3201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.030902 (+ 1356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.030908 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.030912 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.031109 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.031820 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.031826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.031829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.032191 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.032341 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.033548 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.033833 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":358,"threads_started":1}
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
I20260806 19:28:01.035633 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.011182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40877 (local address 127.17.18.66:35679)
0806 19:28:01.012147 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:01.012211 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:01.014680 (+ 2469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:01.015704 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:01.015719 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:01.016523 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:01.017489 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:01.017523 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.018993 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.018999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:01.020988 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:01.021008 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.022054 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.022064 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:01.022320 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.023036 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:01.023062 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:01.025860 (+ 2798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:01.029801 (+ 3941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:01.029815 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:01.029840 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:01.030663 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:01.031251 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:01.031257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:01.031261 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:01.031615 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:01.032356 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:01.032367 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:01.032950 (+ 583us) client_negotiation.cc:769] Sending connection context
0806 19:28:01.033324 (+ 374us) client_negotiation.cc:240] Negotiation successful
0806 19:28:01.034107 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":371,"threads_started":1}
I20260806 19:28:01.037443 22377 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
I20260806 19:28:01.037889 22377 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:01.039183 22377 heartbeater.cc:511] Master 127.17.18.126:40877 requested a full tablet report, sending...
I20260806 19:28:01.041149 21918 ts_manager.cc:194] Registered new tserver with Master: 3e31430cb7ad41c1b8661213ee22025d (127.17.18.66:44707)
I20260806 19:28:01.042125 21918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:35679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:28:01.071648 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:01.444193 22386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:01.444496 22386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:01.444626 22386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:01.452102 22386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:01.452236 22386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:01.452379 22386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:01.462710 22386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:01.464145 22386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:01.464129 22184 heartbeater.cc:503] Master 127.17.18.126:40877 was elected leader, sending a full tablet report...
I20260806 19:28:01.465898 22386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:01.481112 22394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:01.481014 22393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:01.480981 22397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:01.482239 22386 server_base.cc:1034] running on GCE node
I20260806 19:28:01.482973 22386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:01.484278 22386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:01.485520 22386 hybrid_clock.cc:648] HybridClock initialized: now 1786044481485436 us; error 73 us; skew 500 ppm
I20260806 19:28:01.485901 22386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:01.489346 22386 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:28:01.491092 22386 webserver.cc:460] Webserver started at http://127.17.18.67:40279/ using document root <none> and password file <none>
I20260806 19:28:01.491878 22386 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:01.492008 22386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:01.492357 22386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:01.495793 22386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "ca6c6b3cc10846ba9c61564b4a1ce388"
format_stamp: "Formatted at 2026-08-06 19:28:01 on dist-test-slave-f0tn"
server_key: "1dd0278f8375dfad56dcfbdf07c87bc4"
server_key_iv: "1e4eaa4f2b49b9440b3b36068d6c8226"
server_key_version: "encryptionkey@0"
I20260806 19:28:01.496752 22386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "ca6c6b3cc10846ba9c61564b4a1ce388"
format_stamp: "Formatted at 2026-08-06 19:28:01 on dist-test-slave-f0tn"
server_key: "1dd0278f8375dfad56dcfbdf07c87bc4"
server_key_iv: "1e4eaa4f2b49b9440b3b36068d6c8226"
server_key_version: "encryptionkey@0"
I20260806 19:28:01.502606 22386 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 19:28:01.506665 22408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:01.508462 22386 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:28:01.508652 22386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "ca6c6b3cc10846ba9c61564b4a1ce388"
format_stamp: "Formatted at 2026-08-06 19:28:01 on dist-test-slave-f0tn"
server_key: "1dd0278f8375dfad56dcfbdf07c87bc4"
server_key_iv: "1e4eaa4f2b49b9440b3b36068d6c8226"
server_key_version: "encryptionkey@0"
I20260806 19:28:01.508853 22386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:01.528191 22386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:01.532749 22386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:01.533022 22386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:01.534243 22386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:01.535797 22386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:01.535877 22386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:01.535969 22386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:01.536026 22386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:01.569828 22386 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:37225
I20260806 19:28:01.569892 22571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:37225 every 8 connection(s)
I20260806 19:28:01.571170 22386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:01.578596 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22386
I20260806 19:28:01.578820 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:01.579264 17481 external_mini_cluster.cc:1428] Setting key 37fa0da5a95ff5877cf6d1f52de251ee
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:01.592931 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.573783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:49445 (local address 127.17.18.126:40877)
0806 19:28:01.574295 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.574302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.575397 (+ 1095us) server_negotiation.cc:407] Connection header received
0806 19:28:01.577308 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.577314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.577450 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.577559 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.579300 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.580330 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.582257 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.582665 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.582785 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.586465 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.586471 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.586474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.586513 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.589430 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.590334 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.590340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.590344 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.590492 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.590979 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.590984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.590987 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.591297 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.591457 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.592250 (+ 793us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.592516 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":235,"threads_started":1}
I20260806 19:28:01.594190 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.574430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40877 (local address 127.17.18.67:49445)
0806 19:28:01.575200 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:01.575259 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:01.576972 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:01.577796 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:01.577806 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:01.578378 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:01.579087 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:01.579111 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.580495 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.580499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:01.582089 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:01.582105 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.582919 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.582927 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:01.583165 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.583849 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:01.583879 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:01.586200 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:01.589636 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:01.589647 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:01.589665 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:01.590182 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:01.590627 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:01.590631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:01.590634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:01.590855 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:01.591442 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:01.591452 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:01.591856 (+ 404us) client_negotiation.cc:769] Sending connection context
0806 19:28:01.592138 (+ 282us) client_negotiation.cc:240] Negotiation successful
0806 19:28:01.592759 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":287,"threads_started":1}
I20260806 19:28:01.595791 22572 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40877
I20260806 19:28:01.596096 22572 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:01.596871 22572 heartbeater.cc:511] Master 127.17.18.126:40877 requested a full tablet report, sending...
I20260806 19:28:01.598577 21918 ts_manager.cc:194] Registered new tserver with Master: ca6c6b3cc10846ba9c61564b4a1ce388 (127.17.18.67:37225)
I20260806 19:28:01.599426 21918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:49445
I20260806 19:28:01.609234 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:01.668500 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.653159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.17.18.126:40877)
0806 19:28:01.653468 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.653475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.653904 (+ 429us) server_negotiation.cc:407] Connection header received
0806 19:28:01.654100 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.654105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.654190 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.654280 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.656056 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.656820 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.658192 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.658619 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.658744 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.662911 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.662917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.662920 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.662962 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.665716 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.666456 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.666460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.666463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.666604 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.666997 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.667000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.667002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.667362 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.667620 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.667927 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.668163 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260806 19:28:01.669145 21918 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38374
I20260806 19:28:01.671051 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22005
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:01.688030 22591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.672254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50732 (local address 127.17.18.65:33699)
0806 19:28:01.672914 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.672921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.672949 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:28:01.673025 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.673035 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.673281 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.673470 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.675065 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.676131 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.677291 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.677919 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.678017 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.682254 (+ 4237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.682270 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.682288 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.682326 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.685218 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.686067 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.686075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.686078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.686223 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.686590 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.686594 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.686597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.687012 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.687262 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.687458 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.687683 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":323,"threads_started":1}
W20260806 19:28:01.689541 22179 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50732
W20260806 19:28:01.690752 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22005: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:28:01.690946 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22005
I20260806 19:28:01.718120 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22193
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:28:01.737576 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.719135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.17.18.66:44707)
0806 19:28:01.719662 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.719669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.719699 (+ 30us) server_negotiation.cc:407] Connection header received
0806 19:28:01.719762 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.719769 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.720035 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.720173 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.721519 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.723148 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.724549 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.725585 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.725731 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.730757 (+ 5026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.730777 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.730796 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.730841 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.733946 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.735035 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.735046 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.735048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.735252 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.735671 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.735676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.735680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.736083 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.736413 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.736771 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.737076 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":246,"threads_started":1}
W20260806 19:28:01.739025 22371 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42384
W20260806 19:28:01.740238 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22193: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:28:01.740459 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22193
I20260806 19:28:01.765688 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22386
Aug 06 19:28:01 dist-test-slave-f0tn krb5kdc[21864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044481, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:28:01.784864 22594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:01.766918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48596 (local address 127.17.18.67:37225)
0806 19:28:01.767660 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:01.767668 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:01.767702 (+ 34us) server_negotiation.cc:407] Connection header received
0806 19:28:01.767773 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:01.767780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:01.768001 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:01.768154 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:01.769691 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.770850 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.772264 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:01.772926 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:01.773053 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:01.777998 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:01.778018 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:01.778039 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:01.778087 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:01.781627 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.782529 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.782540 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.782542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.782741 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:01.783159 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:01.783162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:01.783164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:01.783565 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:01.783820 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:01.784223 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 19:28:01.784473 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":377,"threads_started":1}
W20260806 19:28:01.786388 22567 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48596
W20260806 19:28:01.787690 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22386: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:28:01.787856 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22386
I20260806 19:28:01.811252 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 21879
I20260806 19:28:01.812552 21960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:01.923509 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 21879
2026-08-06T19:28:01Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4176 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:02 dist-test-slave-f0tn krb5kdc[22602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:02 dist-test-slave-f0tn krb5kdc[22602](info): set up 2 sockets
Aug 06 19:28:02 dist-test-slave-f0tn krb5kdc[22602](info): commencing operation
krb5kdc: starting...
W20260806 19:28:03.133302 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.004s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:03 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:28:03.395442 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:35491
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:35491
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:03.767258 22623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:03.767619 22623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:03.767766 22623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:03.775936 22623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:03.776111 22623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:03.776198 22623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:03.776284 22623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:03.776340 22623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:03.787070 22623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:35491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:35491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:03.788579 22623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:03.790215 22623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:03.803345 22639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:03.803380 22636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:03.803391 22633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:03.804244 22623 server_base.cc:1034] running on GCE node
I20260806 19:28:03.805187 22623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:03.806964 22623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:03.808264 22623 hybrid_clock.cc:648] HybridClock initialized: now 1786044483808202 us; error 54 us; skew 500 ppm
I20260806 19:28:03.808701 22623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:03 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044483, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:03.816987 22623 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:28:03.819063 22623 webserver.cc:460] Webserver started at http://127.17.18.126:44385/ using document root <none> and password file <none>
I20260806 19:28:03.819911 22623 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:03.820070 22623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:03.820436 22623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:03.823985 22623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "172f37c8c9b9416e8e44d6393be864f8"
format_stamp: "Formatted at 2026-08-06 19:28:03 on dist-test-slave-f0tn"
server_key: "cd853ad52bf91c57864e8262bb9de823"
server_key_iv: "88c354187278b635c1396495ce5c401c"
server_key_version: "encryptionkey@0"
I20260806 19:28:03.824954 22623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "172f37c8c9b9416e8e44d6393be864f8"
format_stamp: "Formatted at 2026-08-06 19:28:03 on dist-test-slave-f0tn"
server_key: "cd853ad52bf91c57864e8262bb9de823"
server_key_iv: "88c354187278b635c1396495ce5c401c"
server_key_version: "encryptionkey@0"
I20260806 19:28:03.831189 22623 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 19:28:03.835487 22650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:03.837251 22623 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 19:28:03.837512 22623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "172f37c8c9b9416e8e44d6393be864f8"
format_stamp: "Formatted at 2026-08-06 19:28:03 on dist-test-slave-f0tn"
server_key: "cd853ad52bf91c57864e8262bb9de823"
server_key_iv: "88c354187278b635c1396495ce5c401c"
server_key_version: "encryptionkey@0"
I20260806 19:28:03.837781 22623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:03.880390 22623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:03.885710 22623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:03.886040 22623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:03.905604 22623 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:35491
I20260806 19:28:03.905638 22714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:35491 every 8 connection(s)
I20260806 19:28:03.907136 22623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:03.911478 22716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:03.912045 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22623
I20260806 19:28:03.912276 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:03.913138 17481 external_mini_cluster.cc:1428] Setting key e7af10ff01d3367dac64a84891b7c209
I20260806 19:28:03.927711 22716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8: Bootstrap starting.
Aug 06 19:28:03 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:03.931977 22716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:03.933233 22716 log.cc:824] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:03.937135 22716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8: No bootstrap required, opened a new log
I20260806 19:28:03.940323 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:03.915613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38162 (local address 127.17.18.126:35491)
0806 19:28:03.916520 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:03.916533 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:03.916582 (+ 49us) server_negotiation.cc:407] Connection header received
0806 19:28:03.918801 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:03.918836 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:03.919342 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:03.919739 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:03.921806 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:03.923229 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:03.925218 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:03.926112 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:03.926297 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:03.931442 (+ 5145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:03.931453 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:03.931472 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:03.931529 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:03.935245 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:03.936308 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:03.936316 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:03.936324 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:03.936524 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:03.937087 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:03.937092 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:03.937094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:03.937850 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:03.938132 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:03.938660 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 19:28:03.939094 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":409,"threads_started":1}
I20260806 19:28:03.946413 22716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } }
I20260806 19:28:03.946875 22716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:03.947039 22716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172f37c8c9b9416e8e44d6393be864f8, State: Initialized, Role: FOLLOWER
I20260806 19:28:03.947706 22716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } }
I20260806 19:28:03.947947 22716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:03.948060 22716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:03.948196 22716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:03.950631 22716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } }
I20260806 19:28:03.951223 22716 leader_election.cc:302] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 172f37c8c9b9416e8e44d6393be864f8; no voters:
I20260806 19:28:03.951824 22716 leader_election.cc:288] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:03.951967 22724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:03.952642 22724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [term 1 LEADER]: Becoming Leader. State: Replica: 172f37c8c9b9416e8e44d6393be864f8, State: Running, Role: LEADER
I20260806 19:28:03.953413 22724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } }
I20260806 19:28:03.954063 22716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:03.956542 22730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 172f37c8c9b9416e8e44d6393be864f8. Latest consensus state: current_term: 1 leader_uuid: "172f37c8c9b9416e8e44d6393be864f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } } }
I20260806 19:28:03.957046 22730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:03.956518 22729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "172f37c8c9b9416e8e44d6393be864f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "172f37c8c9b9416e8e44d6393be864f8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 35491 } } }
I20260806 19:28:03.957265 22729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:03.957998 22734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:03.963369 22734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:03.974121 22734 catalog_manager.cc:1347] Generated new cluster ID: c9a53319edd24a359cee9fc7b5cabfb0
I20260806 19:28:03.974277 22734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:03.987571 22734 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:03.989151 22734 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:03.997515 22734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 172f37c8c9b9416e8e44d6393be864f8: Generated new TSK 0
I20260806 19:28:03.998504 22734 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:28:04.070397 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:04.491196 22764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:04.491627 22764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:04.491778 22764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:04.499979 22764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:04.500162 22764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:04.500329 22764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:04.511059 22764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:04.512568 22764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:04.514074 22764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:04.529274 22772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:04.529297 22773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:04.529353 22777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:04.530247 22764 server_base.cc:1034] running on GCE node
I20260806 19:28:04.530951 22764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:04.532018 22764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:04.533245 22764 hybrid_clock.cc:648] HybridClock initialized: now 1786044484533192 us; error 48 us; skew 500 ppm
I20260806 19:28:04.533615 22764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:04 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:04.537070 22764 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:28:04.538906 22764 webserver.cc:460] Webserver started at http://127.17.18.65:41159/ using document root <none> and password file <none>
I20260806 19:28:04.539655 22764 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:04.539773 22764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:04.540067 22764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:04.543397 22764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "6be20d659ea74a62a93c3ab0a8f57fc1"
format_stamp: "Formatted at 2026-08-06 19:28:04 on dist-test-slave-f0tn"
server_key: "96da9262037aeb9aa619ec64dea1c04a"
server_key_iv: "34b2a11b73f8582c6ebd0f678aa00e04"
server_key_version: "encryptionkey@0"
I20260806 19:28:04.544236 22764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "6be20d659ea74a62a93c3ab0a8f57fc1"
format_stamp: "Formatted at 2026-08-06 19:28:04 on dist-test-slave-f0tn"
server_key: "96da9262037aeb9aa619ec64dea1c04a"
server_key_iv: "34b2a11b73f8582c6ebd0f678aa00e04"
server_key_version: "encryptionkey@0"
I20260806 19:28:04.549988 22764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 19:28:04.554258 22791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:04.556267 22764 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:04.556469 22764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "6be20d659ea74a62a93c3ab0a8f57fc1"
format_stamp: "Formatted at 2026-08-06 19:28:04 on dist-test-slave-f0tn"
server_key: "96da9262037aeb9aa619ec64dea1c04a"
server_key_iv: "34b2a11b73f8582c6ebd0f678aa00e04"
server_key_version: "encryptionkey@0"
I20260806 19:28:04.556694 22764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:04.582324 22764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:04.587219 22764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:04.587527 22764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:04.588621 22764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:04.590245 22764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:04.590327 22764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:04.590436 22764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:04.590497 22764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:04.624513 22764 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42491
I20260806 19:28:04.624583 22966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42491 every 8 connection(s)
I20260806 19:28:04.625980 22764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:04.631603 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22764
I20260806 19:28:04.631829 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:04.632473 17481 external_mini_cluster.cc:1428] Setting key bcf0b8482950c1b08c33c64ef48bea60
Aug 06 19:28:04 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044484, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:04.650333 22969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:04.629109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:34285 (local address 127.17.18.126:35491)
0806 19:28:04.629711 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:04.629717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:04.630808 (+ 1091us) server_negotiation.cc:407] Connection header received
0806 19:28:04.632869 (+ 2061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:04.632875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:04.632973 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:04.633106 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:04.635608 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:04.636625 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:04.638653 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:04.639206 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:04.639341 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:04.643524 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:04.643532 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:04.643537 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:04.643582 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:04.646303 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:04.647471 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:04.647476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:04.647479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:04.647655 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:04.648224 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:04.648229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:04.648232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:04.648595 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:04.648729 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:04.649772 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0806 19:28:04.649999 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":294,"threads_started":1}
I20260806 19:28:04.651762 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:04.629735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:35491 (local address 127.17.18.65:34285)
0806 19:28:04.630599 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:04.630654 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:04.632517 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:04.633508 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:04.633520 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:04.634375 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:04.635363 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:04.635395 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:04.636825 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:04.636830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:04.638462 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:04.638481 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:04.639494 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:04.639500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:04.639776 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:04.640548 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:04.640576 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:04.643189 (+ 2613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:04.646511 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:04.646524 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:04.646548 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:04.647282 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:04.647788 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:04.647793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:04.647796 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:04.648066 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:04.648764 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:04.648775 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:04.649280 (+ 505us) client_negotiation.cc:769] Sending connection context
0806 19:28:04.649643 (+ 363us) client_negotiation.cc:240] Negotiation successful
0806 19:28:04.650233 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":338,"threads_started":1}
I20260806 19:28:04.653688 22967 heartbeater.cc:347] Connected to a master server at 127.17.18.126:35491
I20260806 19:28:04.654114 22967 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:04.655119 22967 heartbeater.cc:511] Master 127.17.18.126:35491 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:28:04.657884 22674 ts_manager.cc:194] Registered new tserver with Master: 6be20d659ea74a62a93c3ab0a8f57fc1 (127.17.18.65:42491)
I20260806 19:28:04.659495 22674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:34285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:28:04.689486 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:05.044776 22973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:05.045145 22973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:05.045331 22973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:05.053040 22973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:05.053216 22973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:05.053418 22973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:05.064792 22973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:05.066339 22973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:05.067858 22973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:05.082368 22988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:05.082399 22984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:05.082425 22982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:05.083315 22973 server_base.cc:1034] running on GCE node
I20260806 19:28:05.083997 22973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:05.085034 22973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:05.086275 22973 hybrid_clock.cc:648] HybridClock initialized: now 1786044485086218 us; error 47 us; skew 500 ppm
I20260806 19:28:05.086615 22973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:05.089924 22973 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:28:05.091602 22973 webserver.cc:460] Webserver started at http://127.17.18.66:45433/ using document root <none> and password file <none>
I20260806 19:28:05.092353 22973 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:05.092483 22973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:05.092813 22973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:05.095918 22973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "6fbfab3a55ed419097cfc7b85b3ca841"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "384566a29d5f95a387d9903e0697732e"
server_key_iv: "ffb1c2c5168eb0e6dafb7ea1330fe8aa"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.096736 22973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "6fbfab3a55ed419097cfc7b85b3ca841"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "384566a29d5f95a387d9903e0697732e"
server_key_iv: "ffb1c2c5168eb0e6dafb7ea1330fe8aa"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.102331 22973 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 19:28:05.106496 23006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:05.108225 22973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:28:05.108444 22973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "6fbfab3a55ed419097cfc7b85b3ca841"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "384566a29d5f95a387d9903e0697732e"
server_key_iv: "ffb1c2c5168eb0e6dafb7ea1330fe8aa"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.108668 22973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:05.123888 22973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:05.129364 22973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:05.129727 22973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:05.130867 22973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:05.133112 22973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:05.133213 22973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:05.133351 22973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:05.133446 22973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 19:28:05.174114 22973 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:44317
I20260806 19:28:05.174307 23157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:44317 every 8 connection(s)
I20260806 19:28:05.175776 22973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:05.186003 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 22973
I20260806 19:28:05.186223 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:05.186672 17481 external_mini_cluster.cc:1428] Setting key 126f4c88b775bf89adf3ba142cbd5904
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:05.201220 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.179286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:39085 (local address 127.17.18.126:35491)
0806 19:28:05.179853 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.179859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.181413 (+ 1554us) server_negotiation.cc:407] Connection header received
0806 19:28:05.183564 (+ 2151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.183571 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.183669 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.183780 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.186027 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.186881 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.189081 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.189618 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.189744 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.194385 (+ 4641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.194391 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.194394 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.194436 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.197177 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.198273 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.198281 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.198284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.198502 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.199057 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.199063 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.199067 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.199493 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.199651 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.200570 (+ 919us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.200838 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":310,"threads_started":1}
I20260806 19:28:05.202124 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.179873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:35491 (local address 127.17.18.66:39085)
0806 19:28:05.181047 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:05.181199 (+ 152us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:05.183175 (+ 1976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:05.184106 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:05.184117 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:05.184772 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:05.185604 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:05.185645 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.187135 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.187142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:05.188861 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:05.188881 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.189905 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.189915 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:05.190241 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.191047 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:05.191083 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:05.194047 (+ 2964us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:05.197411 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:05.197424 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:05.197447 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:05.198070 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:05.198666 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:05.198670 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:05.198672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:05.198894 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:05.199621 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:05.199646 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:05.200108 (+ 462us) client_negotiation.cc:769] Sending connection context
0806 19:28:05.200400 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 19:28:05.200865 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":590,"threads_started":1}
I20260806 19:28:05.203974 23161 heartbeater.cc:347] Connected to a master server at 127.17.18.126:35491
I20260806 19:28:05.204332 23161 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:05.205168 23161 heartbeater.cc:511] Master 127.17.18.126:35491 requested a full tablet report, sending...
I20260806 19:28:05.207000 22674 ts_manager.cc:194] Registered new tserver with Master: 6fbfab3a55ed419097cfc7b85b3ca841 (127.17.18.66:44317)
I20260806 19:28:05.207990 22674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:39085
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:28:05.246539 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:05.597956 23169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:05.598311 23169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:05.598444 23169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:05.606516 23169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:05.606675 23169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:05.606832 23169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:05.618057 23169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:35491
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:05.619593 23169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:05.621130 23169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:05.636747 23178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:05.636830 23183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:05.636771 23180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:05.638171 23169 server_base.cc:1034] running on GCE node
I20260806 19:28:05.638926 23169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:05.640018 23169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:05.641414 23169 hybrid_clock.cc:648] HybridClock initialized: now 1786044485641311 us; error 70 us; skew 500 ppm
I20260806 19:28:05.641957 23169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:05.645371 23169 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:28:05.647145 23169 webserver.cc:460] Webserver started at http://127.17.18.67:34669/ using document root <none> and password file <none>
I20260806 19:28:05.647888 23169 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:05.648000 23169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:05.648300 23169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:05.651515 23169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "0e573ef020ab4c0a9b8e997b91271592"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "eeb1d92119b01f2b3a7c89bdac400051"
server_key_iv: "914830b0d79807d9221ae432c0ea291e"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.652359 23169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "0e573ef020ab4c0a9b8e997b91271592"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "eeb1d92119b01f2b3a7c89bdac400051"
server_key_iv: "914830b0d79807d9221ae432c0ea291e"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.658721 23169 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 19:28:05.662985 23194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:05.663684 22967 heartbeater.cc:503] Master 127.17.18.126:35491 was elected leader, sending a full tablet report...
I20260806 19:28:05.664664 23169 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:05.664840 23169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "0e573ef020ab4c0a9b8e997b91271592"
format_stamp: "Formatted at 2026-08-06 19:28:05 on dist-test-slave-f0tn"
server_key: "eeb1d92119b01f2b3a7c89bdac400051"
server_key_iv: "914830b0d79807d9221ae432c0ea291e"
server_key_version: "encryptionkey@0"
I20260806 19:28:05.665057 23169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:05.684319 23169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:05.688889 23169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:05.689214 23169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:05.690369 23169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:05.691915 23169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:05.692003 23169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:05.692142 23169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:05.692198 23169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:05.724789 23169 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44519
I20260806 19:28:05.724828 23357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44519 every 8 connection(s)
I20260806 19:28:05.726270 23169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:05.732487 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 23169
I20260806 19:28:05.732705 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:05.733162 17481 external_mini_cluster.cc:1428] Setting key c49bf30b339a35011056a397866a2a7b
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:05.748401 23361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.729047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:36485 (local address 127.17.18.126:35491)
0806 19:28:05.729583 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.729590 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.730563 (+ 973us) server_negotiation.cc:407] Connection header received
0806 19:28:05.732457 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.732464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.732562 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.732701 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.734558 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.735517 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.737199 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.737683 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.737817 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.741701 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.741708 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.741726 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.741771 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.744657 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.745601 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.745606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.745608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.745754 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.746243 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.746248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.746250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.746576 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.746733 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.747630 (+ 897us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.747965 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":242,"threads_started":1}
I20260806 19:28:05.749503 23362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.729598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:35491 (local address 127.17.18.67:36485)
0806 19:28:05.730371 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:05.730422 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:05.732141 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:05.732967 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:05.732977 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:05.733620 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:05.734358 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:05.734388 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.735686 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.735690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:05.737037 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:05.737051 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.737902 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.737907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:05.738115 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.738812 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:05.738844 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:05.741331 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:05.744864 (+ 3533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:05.744874 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:05.744892 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:05.745440 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:05.745882 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:05.745886 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:05.745888 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:05.746113 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:05.746720 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:05.746729 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:05.747120 (+ 391us) client_negotiation.cc:769] Sending connection context
0806 19:28:05.747473 (+ 353us) client_negotiation.cc:240] Negotiation successful
0806 19:28:05.748047 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":290,"threads_started":1}
I20260806 19:28:05.751211 23359 heartbeater.cc:347] Connected to a master server at 127.17.18.126:35491
I20260806 19:28:05.751556 23359 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:05.752424 23359 heartbeater.cc:511] Master 127.17.18.126:35491 requested a full tablet report, sending...
I20260806 19:28:05.754195 22674 ts_manager.cc:194] Registered new tserver with Master: 0e573ef020ab4c0a9b8e997b91271592 (127.17.18.67:44519)
I20260806 19:28:05.755129 22674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:36485
I20260806 19:28:05.762493 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:05.825492 23368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.806766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46842 (local address 127.17.18.65:42491)
0806 19:28:05.807529 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.807537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.807564 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:28:05.807634 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.807642 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.807862 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.808153 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.810139 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.811434 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.812933 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.813687 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.813826 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.818434 (+ 4608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.818455 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.818475 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.818522 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.822156 (+ 3634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.823056 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.823065 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.823068 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.823238 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.823674 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.823679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.823681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.824094 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.824418 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.824753 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.825056 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":371,"threads_started":1}
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:05.845829 23361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.830993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40656 (local address 127.17.18.126:35491)
0806 19:28:05.831293 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.831299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.831405 (+ 106us) server_negotiation.cc:407] Connection header received
0806 19:28:05.831584 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.831588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.831658 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.831744 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.833116 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.833979 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.835280 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.835698 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.835800 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.840223 (+ 4423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.840229 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.840233 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.840279 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.843154 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.843990 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.843994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.843997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.844174 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.844495 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.844497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.844500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.844846 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.845086 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.845281 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.845526 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260806 19:28:05.846486 22674 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40656
I20260806 19:28:05.847640 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22764
I20260806 19:28:05.861541 23368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.848572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46858 (local address 127.17.18.65:42491)
0806 19:28:05.848777 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.848783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.849043 (+ 260us) server_negotiation.cc:407] Connection header received
0806 19:28:05.849222 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.849227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.849326 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.849444 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.850786 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.851503 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.852925 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.853372 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.853567 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.856075 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.856081 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.856084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.856127 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.858738 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.859478 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.859483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.859485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.859637 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.860039 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.860044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.860047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.860362 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.860616 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.860930 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.861172 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 19:28:05.862295 22954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:05.947134 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22764
I20260806 19:28:05.972721 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22973
Aug 06 19:28:05 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:28:05.992331 23379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:05.973848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33624 (local address 127.17.18.66:44317)
0806 19:28:05.974658 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:05.974666 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:05.974694 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:28:05.974760 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:05.974766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:05.975004 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:05.975189 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:05.976698 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.977907 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.979509 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:05.980332 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:05.980475 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:05.985590 (+ 5115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:05.985611 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:05.985633 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:05.985689 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:05.988886 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.989997 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.990007 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.990009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.990184 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:05.990670 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:05.990674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:05.990677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:05.991134 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:05.991411 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:05.991750 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 19:28:05.991985 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":412,"threads_started":1}
I20260806 19:28:05.993887 23151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:06.079865 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22973
I20260806 19:28:06.102422 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 23169
Aug 06 19:28:06 dist-test-slave-f0tn krb5kdc[22602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:28:06.120677 23382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:06.103553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43898 (local address 127.17.18.67:44519)
0806 19:28:06.104249 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:06.104256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:06.104330 (+ 74us) server_negotiation.cc:407] Connection header received
0806 19:28:06.104516 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:06.104528 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:06.104757 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:06.104893 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:06.106339 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:06.107449 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:06.108769 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:06.109522 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:06.109661 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:06.114422 (+ 4761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:06.114439 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:06.114458 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:06.114501 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:06.117512 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:06.118362 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:06.118371 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:06.118374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:06.118571 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:06.119072 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:06.119076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:06.119078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:06.119493 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:06.119776 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:06.120039 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 19:28:06.120276 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":322,"threads_started":1}
I20260806 19:28:06.122222 23353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:06.207760 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 23169
I20260806 19:28:06.234066 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 22623
I20260806 19:28:06.235757 22709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:06.346324 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 22623
2026-08-06T19:28:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4428 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:06 dist-test-slave-f0tn krb5kdc[23390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:06 dist-test-slave-f0tn krb5kdc[23390](info): set up 2 sockets
Aug 06 19:28:06 dist-test-slave-f0tn krb5kdc[23390](info): commencing operation
krb5kdc: starting...
W20260806 19:28:07.580945 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:07 dist-test-slave-f0tn krb5kdc[23390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:28:07.839134 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:39555
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:39555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:08.210913 23415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:08.211304 23415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:08.211432 23415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:08.220435 23415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:08.220599 23415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:08.220651 23415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:08.220716 23415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:08.220798 23415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:08.233855 23415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:39555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:39555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:08.235423 23415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:08.236963 23415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:08.252331 23431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:08.252437 23429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:08.253017 23415 server_base.cc:1034] running on GCE node
W20260806 19:28:08.253166 23434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:08.254184 23415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:08.255955 23415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:08.257238 23415 hybrid_clock.cc:648] HybridClock initialized: now 1786044488257156 us; error 76 us; skew 500 ppm
I20260806 19:28:08.257717 23415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:08 dist-test-slave-f0tn krb5kdc[23390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044488, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:08.261566 23415 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:28:08.263182 23415 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:08.263319 23415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:08.263696 23415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:08.267581 23415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "180b370eedda4c3596de15ce1f6ff1c3"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "9845c8285c13b17487929bc62779f73f"
server_key_iv: "469c394c093ea3d936ffc5c6781d3fd6"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.268649 23415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "180b370eedda4c3596de15ce1f6ff1c3"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "9845c8285c13b17487929bc62779f73f"
server_key_iv: "469c394c093ea3d936ffc5c6781d3fd6"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.274967 23415 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 19:28:08.279156 23446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:08.281370 23415 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 19:28:08.281702 23415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "180b370eedda4c3596de15ce1f6ff1c3"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "9845c8285c13b17487929bc62779f73f"
server_key_iv: "469c394c093ea3d936ffc5c6781d3fd6"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.281993 23415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:08.300093 23415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:08.305094 23415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:08.305426 23415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:08.325332 23415 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:39555
I20260806 19:28:08.325352 23518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:39555 every 8 connection(s)
I20260806 19:28:08.326359 23415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:08.330559 23520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:08.336550 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 23415
I20260806 19:28:08.336782 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:08.337620 17481 external_mini_cluster.cc:1428] Setting key b26fe20276399b5eadb8b1ec0d53dd15
I20260806 19:28:08.344955 23520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: Bootstrap starting.
I20260806 19:28:08.349653 23520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:08.351105 23520 log.cc:824] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:08.355398 23520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: No bootstrap required, opened a new log
Aug 06 19:28:08 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:08.364996 23520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } }
I20260806 19:28:08.365492 23520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:08.365602 23520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180b370eedda4c3596de15ce1f6ff1c3, State: Initialized, Role: FOLLOWER
I20260806 19:28:08.365644 23523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:08.339990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58914 (local address 127.17.18.126:39555)
0806 19:28:08.340916 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:08.340930 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:08.340978 (+ 48us) server_negotiation.cc:407] Connection header received
0806 19:28:08.342992 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:08.343033 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:08.343499 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:08.344057 (+ 558us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:08.346894 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:08.348631 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:08.350581 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:08.351529 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:08.351708 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:08.356992 (+ 5284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:08.357002 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:08.357025 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:08.357075 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:08.360597 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:08.361596 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:08.361605 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:08.361613 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:08.361840 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:08.362340 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:08.362345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:08.362347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:08.363078 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:08.363352 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:08.363868 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 19:28:08.364385 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":375,"threads_started":1}
I20260806 19:28:08.366487 23520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } }
I20260806 19:28:08.366788 23520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:08.366930 23520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:08.367138 23520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:08.369908 23520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } }
I20260806 19:28:08.370427 23520 leader_election.cc:302] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 180b370eedda4c3596de15ce1f6ff1c3; no voters:
I20260806 19:28:08.370991 23520 leader_election.cc:288] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:08.371155 23527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:08.371774 23527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [term 1 LEADER]: Becoming Leader. State: Replica: 180b370eedda4c3596de15ce1f6ff1c3, State: Running, Role: LEADER
I20260806 19:28:08.372335 23527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } }
I20260806 19:28:08.373051 23520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:08.375916 23533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 180b370eedda4c3596de15ce1f6ff1c3. Latest consensus state: current_term: 1 leader_uuid: "180b370eedda4c3596de15ce1f6ff1c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } } }
I20260806 19:28:08.376150 23529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "180b370eedda4c3596de15ce1f6ff1c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "180b370eedda4c3596de15ce1f6ff1c3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 39555 } } }
I20260806 19:28:08.376473 23533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:08.376601 23529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:08.378382 23538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:08.390713 23538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:08.407488 23538 catalog_manager.cc:1347] Generated new cluster ID: 08a07848e2b74d529dc4f056e406a53b
I20260806 19:28:08.407632 23538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:08.426649 23538 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:08.428639 23538 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:08.454656 23538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: Generated new TSK 0
I20260806 19:28:08.455894 23538 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:28:08.530216 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:08.891860 23555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:08.892179 23555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:08.892307 23555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:08.899806 23555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:08.899945 23555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:08.900102 23555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:08.911128 23555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:08.912642 23555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:08.914180 23555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:08.928056 23563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:08.928109 23568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:08.928076 23565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:08.929085 23555 server_base.cc:1034] running on GCE node
I20260806 19:28:08.929780 23555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:08.930831 23555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:08.932070 23555 hybrid_clock.cc:648] HybridClock initialized: now 1786044488932021 us; error 37 us; skew 500 ppm
I20260806 19:28:08.932415 23555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:08 dist-test-slave-f0tn krb5kdc[23390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044488, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:08.940057 23555 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:28:08.941654 23555 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:08.941792 23555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:08.942147 23555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:08.945276 23555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "77955a5cbf7440ba9c1aba6d067d80bc"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "eaa6f228ae99d2eccf15ab0ea4123620"
server_key_iv: "1e4b4c758b12436b5e28d7f96ddc0559"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.946175 23555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "77955a5cbf7440ba9c1aba6d067d80bc"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "eaa6f228ae99d2eccf15ab0ea4123620"
server_key_iv: "1e4b4c758b12436b5e28d7f96ddc0559"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.952134 23555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:08.956270 23578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:08.957798 23555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:08.957978 23555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "77955a5cbf7440ba9c1aba6d067d80bc"
format_stamp: "Formatted at 2026-08-06 19:28:08 on dist-test-slave-f0tn"
server_key: "eaa6f228ae99d2eccf15ab0ea4123620"
server_key_iv: "1e4b4c758b12436b5e28d7f96ddc0559"
server_key_version: "encryptionkey@0"
I20260806 19:28:08.958248 23555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:08.979990 23555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:08.984712 23555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:08.984997 23555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:08.986089 23555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:08.987749 23555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:08.987854 23555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:08.987968 23555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:08.988051 23555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:09.020661 23555 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:32977
I20260806 19:28:09.020709 23753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:32977 every 8 connection(s)
I20260806 19:28:09.021615 23555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:09.025970 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 23555
I20260806 19:28:09.026207 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:09.027064 17481 external_mini_cluster.cc:1428] Setting key c08cd80284b3f8c6e53f81248e381c0a
Aug 06 19:28:09 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044488, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:09.045243 23757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:09.024159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43045 (local address 127.17.18.126:39555)
0806 19:28:09.024641 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:09.024648 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:09.025926 (+ 1278us) server_negotiation.cc:407] Connection header received
0806 19:28:09.028370 (+ 2444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:09.028375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:09.028447 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:09.028550 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:09.030726 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.031534 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.033770 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.034229 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.034339 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:09.038994 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:09.039002 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:09.039008 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:09.039057 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:09.041767 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:09.042662 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:09.042667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:09.042669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:09.042820 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:09.043299 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:09.043304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:09.043306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:09.043605 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:09.043768 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:09.044584 (+ 816us) server_negotiation.cc:299] Negotiation successful
0806 19:28:09.044861 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":218,"threads_started":1}
I20260806 19:28:09.046489 23759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:09.024747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:39555 (local address 127.17.18.65:43045)
0806 19:28:09.025682 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:09.025759 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:09.028085 (+ 2326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:09.028851 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:09.028863 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:09.029584 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:09.030494 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:09.030522 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.031723 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.031728 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:09.033585 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:09.033602 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.034479 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.034487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:09.034790 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:09.035572 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:09.035602 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:09.038613 (+ 3011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:09.041960 (+ 3347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:09.041972 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:09.041991 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:09.042513 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:09.042943 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:09.042949 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:09.042953 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:09.043166 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:09.043752 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:09.043761 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:09.044156 (+ 395us) client_negotiation.cc:769] Sending connection context
0806 19:28:09.044445 (+ 289us) client_negotiation.cc:240] Negotiation successful
0806 19:28:09.045067 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":386,"threads_started":1}
I20260806 19:28:09.048352 23754 heartbeater.cc:347] Connected to a master server at 127.17.18.126:39555
I20260806 19:28:09.048703 23754 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:09.049456 23754 heartbeater.cc:511] Master 127.17.18.126:39555 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:28:09.051891 23471 ts_manager.cc:194] Registered new tserver with Master: 77955a5cbf7440ba9c1aba6d067d80bc (127.17.18.65:32977)
I20260806 19:28:09.053596 23471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:43045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:28:09.085757 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:09.448614 23764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:09.448913 23764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:09.449015 23764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:09.456751 23764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:09.456884 23764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:09.457005 23764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:09.467447 23764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:09.468883 23764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:09.470342 23764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:09.484485 23770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:09.484516 23771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:09.485165 23773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:09.485487 23764 server_base.cc:1034] running on GCE node
I20260806 19:28:09.486249 23764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:09.487413 23764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:09.488643 23764 hybrid_clock.cc:648] HybridClock initialized: now 1786044489488589 us; error 59 us; skew 500 ppm
I20260806 19:28:09.488982 23764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:09 dist-test-slave-f0tn krb5kdc[23390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:09.492571 23764 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:28:09.493943 23764 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:09.494069 23764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:09.494413 23764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:09.497850 23764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "410bc037193d4efd8aeb4020a9711fc9"
format_stamp: "Formatted at 2026-08-06 19:28:09 on dist-test-slave-f0tn"
server_key: "66ec4b6c0541bc822005ee63086f6d49"
server_key_iv: "47c7f50bfe4172e2a9f60ec9abcb8909"
server_key_version: "encryptionkey@0"
I20260806 19:28:09.498729 23764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "410bc037193d4efd8aeb4020a9711fc9"
format_stamp: "Formatted at 2026-08-06 19:28:09 on dist-test-slave-f0tn"
server_key: "66ec4b6c0541bc822005ee63086f6d49"
server_key_iv: "47c7f50bfe4172e2a9f60ec9abcb8909"
server_key_version: "encryptionkey@0"
I20260806 19:28:09.504560 23764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:28:09.508692 23779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:09.510392 23764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:09.510589 23764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "410bc037193d4efd8aeb4020a9711fc9"
format_stamp: "Formatted at 2026-08-06 19:28:09 on dist-test-slave-f0tn"
server_key: "66ec4b6c0541bc822005ee63086f6d49"
server_key_iv: "47c7f50bfe4172e2a9f60ec9abcb8909"
server_key_version: "encryptionkey@0"
I20260806 19:28:09.510850 23764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:09.531522 23764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:09.536501 23764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:09.536836 23764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:09.537967 23764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:09.539505 23764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:09.539608 23764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:09.539727 23764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:09.539811 23764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:09.572571 23764 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:38859
I20260806 19:28:09.572609 23953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:38859 every 8 connection(s)
I20260806 19:28:09.573580 23764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:09.582890 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 23764
I20260806 19:28:09.583106 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:09.583577 17481 external_mini_cluster.cc:1428] Setting key 4cc661462f6b96a80a2fc44922454763
Aug 06 19:28:09 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044489, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:09.597496 23956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:09.576435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:50471 (local address 127.17.18.126:39555)
0806 19:28:09.576899 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:09.576904 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:09.577968 (+ 1064us) server_negotiation.cc:407] Connection header received
0806 19:28:09.579978 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:09.579985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:09.580077 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:09.580184 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:09.581998 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.582763 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.584537 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.585211 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.585344 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:09.590276 (+ 4932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:09.590282 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:09.590286 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:09.590328 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:09.593229 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:09.594448 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:09.594454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:09.594456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:09.594642 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:09.595259 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:09.595263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:09.595266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:09.595606 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:09.595760 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:09.596742 (+ 982us) server_negotiation.cc:299] Negotiation successful
0806 19:28:09.597081 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":242,"threads_started":1}
I20260806 19:28:09.598467 23957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:09.576970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:39555 (local address 127.17.18.66:50471)
0806 19:28:09.577787 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:09.577830 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:09.579661 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:09.580480 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:09.580489 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:09.581072 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:09.581798 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:09.581819 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.582930 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.582934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:09.584367 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:09.584382 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:09.585504 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:09.585516 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:09.585799 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:09.586672 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:09.586802 (+ 130us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:09.589894 (+ 3092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:09.593484 (+ 3590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:09.593496 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:09.593520 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:09.594249 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:09.594784 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:09.594789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:09.594792 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:09.595082 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:09.595819 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:09.595829 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:09.596276 (+ 447us) client_negotiation.cc:769] Sending connection context
0806 19:28:09.596549 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 19:28:09.597024 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":342,"threads_started":1}
I20260806 19:28:09.600339 23954 heartbeater.cc:347] Connected to a master server at 127.17.18.126:39555
I20260806 19:28:09.600772 23954 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:09.601790 23954 heartbeater.cc:511] Master 127.17.18.126:39555 requested a full tablet report, sending...
I20260806 19:28:09.604095 23471 ts_manager.cc:194] Registered new tserver with Master: 410bc037193d4efd8aeb4020a9711fc9 (127.17.18.66:38859)
I20260806 19:28:09.605011 23471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:50471
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:28:09.644778 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:10.009423 23960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:10.009817 23960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:10.009971 23960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:10.018371 23960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:10.018539 23960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:10.018707 23960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:10.031491 23960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:39555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:10.032929 23960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:10.034466 23960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:10.048815 23970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:10.048877 23971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:10.048875 23974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:10.050812 23960 server_base.cc:1034] running on GCE node
I20260806 19:28:10.051796 23960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:10.052994 23960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:10.054260 23960 hybrid_clock.cc:648] HybridClock initialized: now 1786044490054172 us; error 78 us; skew 500 ppm
I20260806 19:28:10.054661 23960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:10.057108 23754 heartbeater.cc:503] Master 127.17.18.126:39555 was elected leader, sending a full tablet report...
Aug 06 19:28:10 dist-test-slave-f0tn krb5kdc[23390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044490, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:10.059806 23960 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:28:10.061339 23960 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:10.061611 23960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:10.062095 23960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:10.065735 23960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "feeec911f3a640d69f2907d10d6ecd5c"
format_stamp: "Formatted at 2026-08-06 19:28:10 on dist-test-slave-f0tn"
server_key: "f91f9cb338c35403ba30a38df074a443"
server_key_iv: "5c17a3400415de4ae143e185621aed7d"
server_key_version: "encryptionkey@0"
I20260806 19:28:10.066663 23960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "feeec911f3a640d69f2907d10d6ecd5c"
format_stamp: "Formatted at 2026-08-06 19:28:10 on dist-test-slave-f0tn"
server_key: "f91f9cb338c35403ba30a38df074a443"
server_key_iv: "5c17a3400415de4ae143e185621aed7d"
server_key_version: "encryptionkey@0"
I20260806 19:28:10.072832 23960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:28:10.077251 23987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:10.079015 23960 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:10.079203 23960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "feeec911f3a640d69f2907d10d6ecd5c"
format_stamp: "Formatted at 2026-08-06 19:28:10 on dist-test-slave-f0tn"
server_key: "f91f9cb338c35403ba30a38df074a443"
server_key_iv: "5c17a3400415de4ae143e185621aed7d"
server_key_version: "encryptionkey@0"
I20260806 19:28:10.079442 23960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:10.100453 23960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:10.105183 23960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:10.105525 23960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:10.106621 23960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:10.108172 23960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:10.108269 23960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:10.108379 23960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:10.108448 23960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:10.141348 23960 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:38491
I20260806 19:28:10.141439 24165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:38491 every 8 connection(s)
I20260806 19:28:10.142298 23960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:10.143486 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 23960
I20260806 19:28:10.143797 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:10.144392 17481 external_mini_cluster.cc:1428] Setting key d335b69912e97e29901a89a7da5e8e69
Aug 06 19:28:10 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044490, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:10.165510 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.145442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:50769 (local address 127.17.18.126:39555)
0806 19:28:10.146006 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.146013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.147035 (+ 1022us) server_negotiation.cc:407] Connection header received
0806 19:28:10.148988 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.148993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.149079 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.149178 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:10.151037 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.151863 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.153694 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.154119 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.154248 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.158497 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:10.158503 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:10.158506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:10.158549 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:10.161652 (+ 3103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.162708 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.162714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.162716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.162874 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.163432 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.163436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.163442 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.163769 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:10.163913 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.164871 (+ 958us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.165134 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":277,"threads_started":1}
I20260806 19:28:10.166567 24171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.146019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:39555 (local address 127.17.18.67:50769)
0806 19:28:10.146860 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.146918 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.148677 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.149526 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.149537 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.150157 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:10.150820 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.150841 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.152080 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.152085 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.153509 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.153524 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.154423 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.154429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.154661 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.155496 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:10.155524 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:10.158135 (+ 2611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:10.161863 (+ 3728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:10.161873 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:10.161892 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:10.162540 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:10.163029 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:10.163034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:10.163036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:10.163262 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:10.163949 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:10.163957 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:10.164375 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.164655 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.165281 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":341,"threads_started":1}
I20260806 19:28:10.168414 24168 heartbeater.cc:347] Connected to a master server at 127.17.18.126:39555
I20260806 19:28:10.168792 24168 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:10.169618 24168 heartbeater.cc:511] Master 127.17.18.126:39555 requested a full tablet report, sending...
I20260806 19:28:10.171398 23471 ts_manager.cc:194] Registered new tserver with Master: feeec911f3a640d69f2907d10d6ecd5c (127.17.18.67:38491)
I20260806 19:28:10.172458 23471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:50769
I20260806 19:28:10.173321 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:28:10.192951 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.178283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58916 (local address 127.17.18.126:39555)
0806 19:28:10.178531 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.178539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.178994 (+ 455us) server_negotiation.cc:407] Connection header received
0806 19:28:10.179260 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.179267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.179352 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.179446 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:10.181009 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.181861 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.183520 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.184269 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.184402 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.187153 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:10.187186 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:10.187190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:10.187243 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:10.190035 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.190806 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.190810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.190812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.190938 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.191307 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.191312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.191314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.191805 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:10.192028 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.192417 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.192623 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 19:28:10.197753 23470 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:10.205186 23470 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:10.231976 24185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.219981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38491 (local address 127.0.0.1:42718)
0806 19:28:10.221550 (+ 1569us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.221596 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.221827 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.224258 (+ 2431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.224265 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.224295 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.224804 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.224818 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.226496 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.226501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.229025 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.229041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.230780 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.230787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.231010 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.231070 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.231249 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.231486 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1240,"mutex_wait_us":69,"thread_start_us":3318,"threads_started":1}
I20260806 19:28:10.233103 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.220244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:32977 (local address 127.0.0.1:39404)
0806 19:28:10.222414 (+ 2170us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.222432 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.222554 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.224409 (+ 1855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.224413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.224448 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.225030 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.225045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.227052 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.227059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.229899 (+ 2840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.229917 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.232127 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.232134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.232342 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.232376 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.232470 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.232619 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2034,"mutex_wait_us":141,"thread_start_us":1886,"threads_started":1}
I20260806 19:28:10.233456 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.220710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42718 (local address 127.17.18.67:38491)
0806 19:28:10.223446 (+ 2736us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.223455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.223494 (+ 39us) server_negotiation.cc:407] Connection header received
0806 19:28:10.223612 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.223621 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.223923 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.224842 (+ 919us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.225157 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.226345 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.229219 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.230528 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.230686 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.230968 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.231304 (+ 336us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.231509 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2559,"thread_start_us":2415,"threads_started":1}
I20260806 19:28:10.233672 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.220964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50592 (local address 127.17.18.66:38859)
0806 19:28:10.223020 (+ 2056us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.223030 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.223765 (+ 735us) server_negotiation.cc:407] Connection header received
0806 19:28:10.223867 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.223874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.224079 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.224265 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.225442 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.226949 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.230285 (+ 3336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.231719 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.231871 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.232088 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.233162 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.233355 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1836,"thread_start_us":1659,"threads_started":1}
I20260806 19:28:10.233577 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.220454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:38859 (local address 127.0.0.1:50592)
0806 19:28:10.223436 (+ 2982us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.223455 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.223639 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.224470 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.224473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.224496 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.225204 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.225220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.227099 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.227104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.229907 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.229917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.232247 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.232253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.232417 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.232451 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.232555 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.232690 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2855,"mutex_wait_us":206,"thread_start_us":696,"threads_started":1}
I20260806 19:28:10.235170 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.221352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39404 (local address 127.17.18.65:32977)
0806 19:28:10.223768 (+ 2416us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.223776 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.223806 (+ 30us) server_negotiation.cc:407] Connection header received
0806 19:28:10.223913 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.223921 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.224158 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.224626 (+ 468us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.225192 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.226808 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.230112 (+ 3304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.231556 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.231710 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.231956 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.233502 (+ 1546us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.234915 (+ 1413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2226,"thread_start_us":1408,"threads_started":1}
I20260806 19:28:10.237944 24070 tablet_service.cc:1467] Processing CreateTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (DEFAULT_TABLE table=test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:10.237944 23846 tablet_service.cc:1467] Processing CreateTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (DEFAULT_TABLE table=test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:10.238309 23653 tablet_service.cc:1467] Processing CreateTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (DEFAULT_TABLE table=test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:10.239596 24070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:10.239594 23846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:10.239615 23653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:10.254227 24193 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Bootstrap starting.
I20260806 19:28:10.257932 24193 tablet_bootstrap.cc:654] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:10.258304 24194 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Bootstrap starting.
I20260806 19:28:10.259169 24195 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Bootstrap starting.
I20260806 19:28:10.259696 24193 log.cc:824] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:10.263391 24193 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: No bootstrap required, opened a new log
I20260806 19:28:10.263368 24194 tablet_bootstrap.cc:654] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:10.263715 24193 ts_tablet_manager.cc:1397] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 19:28:10.264356 24195 tablet_bootstrap.cc:654] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:10.264791 24194 log.cc:824] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:10.265726 24195 log.cc:824] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:10.268292 24194 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: No bootstrap required, opened a new log
I20260806 19:28:10.268602 24194 ts_tablet_manager.cc:1397] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260806 19:28:10.269163 24195 tablet_bootstrap.cc:492] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: No bootstrap required, opened a new log
I20260806 19:28:10.269508 24195 ts_tablet_manager.cc:1397] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260806 19:28:10.274731 24193 raft_consensus.cc:348] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.275331 24193 raft_consensus.cc:374] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:10.275488 24193 raft_consensus.cc:729] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77955a5cbf7440ba9c1aba6d067d80bc, State: Initialized, Role: FOLLOWER
I20260806 19:28:10.276244 24193 consensus_queue.cc:260] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.277033 24194 raft_consensus.cc:348] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.277611 24194 raft_consensus.cc:374] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:10.277762 24194 raft_consensus.cc:729] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410bc037193d4efd8aeb4020a9711fc9, State: Initialized, Role: FOLLOWER
I20260806 19:28:10.278309 24193 ts_tablet_manager.cc:1428] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260806 19:28:10.278672 24194 consensus_queue.cc:260] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.280543 24195 raft_consensus.cc:348] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.280926 24195 raft_consensus.cc:374] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:10.281030 24195 raft_consensus.cc:729] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feeec911f3a640d69f2907d10d6ecd5c, State: Initialized, Role: FOLLOWER
I20260806 19:28:10.281749 24195 consensus_queue.cc:260] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.283828 24195 ts_tablet_manager.cc:1428] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260806 19:28:10.284488 24168 heartbeater.cc:503] Master 127.17.18.126:39555 was elected leader, sending a full tablet report...
I20260806 19:28:10.286963 24194 ts_tablet_manager.cc:1428] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Time spent starting tablet: real 0.018s user 0.018s sys 0.000s
I20260806 19:28:10.287408 23954 heartbeater.cc:503] Master 127.17.18.126:39555 was elected leader, sending a full tablet report...
I20260806 19:28:10.289363 24201 raft_consensus.cc:482] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:10.290052 24201 raft_consensus.cc:504] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.287510 24200 raft_consensus.cc:482] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:10.290660 24200 raft_consensus.cc:504] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.299152 24200 leader_election.cc:288] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers feeec911f3a640d69f2907d10d6ecd5c (127.17.18.67:38491), 410bc037193d4efd8aeb4020a9711fc9 (127.17.18.66:38859)
I20260806 19:28:10.299881 24201 leader_election.cc:288] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers feeec911f3a640d69f2907d10d6ecd5c (127.17.18.67:38491), 77955a5cbf7440ba9c1aba6d067d80bc (127.17.18.65:32977)
I20260806 19:28:10.301426 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.292635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:56409 (local address 127.17.18.67:38491)
0806 19:28:10.293145 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.293152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.293372 (+ 220us) server_negotiation.cc:407] Connection header received
0806 19:28:10.293706 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.293713 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.293788 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.293847 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.294689 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.295859 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.298655 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.299969 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.300140 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.300226 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.300934 (+ 708us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.301098 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348}
I20260806 19:28:10.302541 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.292543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38491 (local address 127.17.18.66:56409)
0806 19:28:10.293267 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.293288 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.293524 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.294069 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.294074 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.294102 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.294504 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.294516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.296056 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.296062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.298439 (+ 2377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.298459 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.300463 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.300470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.300732 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.300769 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.301898 (+ 1129us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.302073 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":394,"threads_started":1}
I20260806 19:28:10.304081 24098 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "410bc037193d4efd8aeb4020a9711fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feeec911f3a640d69f2907d10d6ecd5c" is_pre_election: true
I20260806 19:28:10.304755 24098 raft_consensus.cc:2454] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 410bc037193d4efd8aeb4020a9711fc9 in term 0.
I20260806 19:28:10.305889 23780 leader_election.cc:302] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 410bc037193d4efd8aeb4020a9711fc9, feeec911f3a640d69f2907d10d6ecd5c; no voters:
I20260806 19:28:10.306402 24201 raft_consensus.cc:2781] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:10.306586 24201 raft_consensus.cc:482] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:10.306710 24201 raft_consensus.cc:3037] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:10.310614 24201 raft_consensus.cc:504] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.312107 24098 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "410bc037193d4efd8aeb4020a9711fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feeec911f3a640d69f2907d10d6ecd5c"
I20260806 19:28:10.312397 24098 raft_consensus.cc:3037] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:10.312489 24201 leader_election.cc:288] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [CANDIDATE]: Term 1 election: Requested vote from peers feeec911f3a640d69f2907d10d6ecd5c (127.17.18.67:38491), 77955a5cbf7440ba9c1aba6d067d80bc (127.17.18.65:32977)
I20260806 19:28:10.313730 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.293269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:51701 (local address 127.17.18.66:38859)
0806 19:28:10.293462 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.293467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.305463 (+ 11996us) server_negotiation.cc:407] Connection header received
0806 19:28:10.305976 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.305982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.306054 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.306111 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.306964 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.308075 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.310941 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.312390 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.312565 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.312642 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.313288 (+ 646us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.313475 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 19:28:10.314774 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.293196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:35581 (local address 127.17.18.67:38491)
0806 19:28:10.301736 (+ 8540us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.301743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.307971 (+ 6228us) server_negotiation.cc:407] Connection header received
0806 19:28:10.308106 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.308111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.308194 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.308278 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.308913 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.309755 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.311770 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.313104 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.313251 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.313329 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.314296 (+ 967us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.314448 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8411,"thread_start_us":13841,"threads_started":1}
I20260806 19:28:10.314836 24207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.292674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:38859 (local address 127.17.18.65:51701)
0806 19:28:10.305335 (+ 12661us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.305359 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.305815 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.306321 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.306325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.306357 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.306778 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.306796 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.308302 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.308309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.310746 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.310763 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.312829 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.312837 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.313084 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.313120 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.314294 (+ 1174us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.314449 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12474,"mutex_wait_us":1,"thread_start_us":12779,"threads_started":1}
I20260806 19:28:10.315548 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.292778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:38491 (local address 127.17.18.65:35581)
0806 19:28:10.307813 (+ 15035us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.307839 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.307990 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.308309 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.308314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.308343 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.308749 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.308759 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.309896 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.309902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.311573 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.311590 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.313920 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.313927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.314097 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.314132 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.315081 (+ 949us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.315234 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14794,"thread_start_us":14594,"threads_started":1}
I20260806 19:28:10.315901 23879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "410bc037193d4efd8aeb4020a9711fc9" is_pre_election: true
I20260806 19:28:10.316154 24098 raft_consensus.cc:2454] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410bc037193d4efd8aeb4020a9711fc9 in term 1.
I20260806 19:28:10.316301 24093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feeec911f3a640d69f2907d10d6ecd5c" is_pre_election: true
I20260806 19:28:10.316646 23879 raft_consensus.cc:2379] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77955a5cbf7440ba9c1aba6d067d80bc in current term 1: Already voted for candidate 410bc037193d4efd8aeb4020a9711fc9 in this term.
I20260806 19:28:10.316747 24093 raft_consensus.cc:2379] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77955a5cbf7440ba9c1aba6d067d80bc in current term 1: Already voted for candidate 410bc037193d4efd8aeb4020a9711fc9 in this term.
I20260806 19:28:10.316850 23780 leader_election.cc:302] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 410bc037193d4efd8aeb4020a9711fc9, feeec911f3a640d69f2907d10d6ecd5c; no voters:
I20260806 19:28:10.317200 24201 raft_consensus.cc:2781] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:10.317438 24201 raft_consensus.cc:686] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 LEADER]: Becoming Leader. State: Replica: 410bc037193d4efd8aeb4020a9711fc9, State: Running, Role: LEADER
I20260806 19:28:10.317952 23579 leader_election.cc:302] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77955a5cbf7440ba9c1aba6d067d80bc; no voters: 410bc037193d4efd8aeb4020a9711fc9, feeec911f3a640d69f2907d10d6ecd5c
I20260806 19:28:10.318066 24201 consensus_queue.cc:237] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } }
I20260806 19:28:10.318486 24200 raft_consensus.cc:3037] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:10.321345 24200 raft_consensus.cc:2726] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 19:28:10.321731 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.293748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:32977 (local address 127.17.18.66:43811)
0806 19:28:10.305495 (+ 11747us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:10.305513 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:10.305882 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:10.311663 (+ 5781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:10.311668 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:10.311721 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:10.312249 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.312267 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.314120 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.314125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.318869 (+ 4744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:10.318891 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.320810 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.320818 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:10.321010 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.321048 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 19:28:10.321150 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 19:28:10.321310 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11591,"thread_start_us":11858,"threads_started":1}
I20260806 19:28:10.321732 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.294231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:43811 (local address 127.17.18.65:32977)
0806 19:28:10.294440 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.294446 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.305587 (+ 11141us) server_negotiation.cc:407] Connection header received
0806 19:28:10.306035 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.306040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.306109 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.306161 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:10.312728 (+ 6567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.313919 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.319146 (+ 5227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.320520 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.320724 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.320813 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.321226 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.321424 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 19:28:10.322834 23682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "410bc037193d4efd8aeb4020a9711fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" is_pre_election: true
I20260806 19:28:10.323367 23682 raft_consensus.cc:2454] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 410bc037193d4efd8aeb4020a9711fc9 in term 1.
I20260806 19:28:10.322898 23681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58b1a8c4a8c24f59b86c8ce7c72cdec6" candidate_uuid: "410bc037193d4efd8aeb4020a9711fc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77955a5cbf7440ba9c1aba6d067d80bc"
W20260806 19:28:10.325914 23955 tablet.cc:2369] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:10.326752 23681 raft_consensus.cc:2454] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 410bc037193d4efd8aeb4020a9711fc9 in term 1.
I20260806 19:28:10.326648 23471 catalog_manager.cc:5495] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 410bc037193d4efd8aeb4020a9711fc9 (127.17.18.66). New cstate: current_term: 1 leader_uuid: "410bc037193d4efd8aeb4020a9711fc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "410bc037193d4efd8aeb4020a9711fc9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260806 19:28:10.362547 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.356769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50606 (local address 127.17.18.66:38859)
0806 19:28:10.356986 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.356991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.357014 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:28:10.357208 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.357212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.357315 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.357479 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:10.357901 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.358692 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.360078 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.360521 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.360639 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.361191 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:10.361895 (+ 704us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:10.362035 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.362147 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.362249 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:28:10.371440 24093 raft_consensus.cc:1261] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 1 FOLLOWER]: Refusing update from remote peer 410bc037193d4efd8aeb4020a9711fc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:10.371477 23681 raft_consensus.cc:1261] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Refusing update from remote peer 410bc037193d4efd8aeb4020a9711fc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:10.372658 24201 consensus_queue.cc:1035] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77955a5cbf7440ba9c1aba6d067d80bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:10.373061 24205 consensus_queue.cc:1035] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feeec911f3a640d69f2907d10d6ecd5c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 38491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:10.387104 24218 mvcc.cc:205] Tried to move back new op lower bound from 7315638232550207488 to 7315638232348770304. Current Snapshot: MvccSnapshot[applied={T|T < 7315638232550207488}]
I20260806 19:28:10.387794 24221 mvcc.cc:205] Tried to move back new op lower bound from 7315638232550207488 to 7315638232348770304. Current Snapshot: MvccSnapshot[applied={T|T < 7315638232550207488}]
I20260806 19:28:10.387982 24222 mvcc.cc:205] Tried to move back new op lower bound from 7315638232550207488 to 7315638232348770304. Current Snapshot: MvccSnapshot[applied={T|T < 7315638232550207488}]
I20260806 19:28:10.401597 23471 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:10.401981 23471 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:10.407155 23471 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 180b370eedda4c3596de15ce1f6ff1c3: Sending DeleteTablet for 3 replicas of tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6
I20260806 19:28:10.408771 23846 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:10 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:50592
I20260806 19:28:10.408761 24070 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:10 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:42718
I20260806 19:28:10.409190 23653 tablet_service.cc:1514] Processing DeleteTablet for tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:10 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:39404
I20260806 19:28:10.410823 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 23555
I20260806 19:28:10.422055 24235 tablet_replica.cc:330] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: stopping tablet replica
I20260806 19:28:10.422675 24235 raft_consensus.cc:2229] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:10.423466 24235 raft_consensus.cc:2258] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:10.424459 24236 tablet_replica.cc:330] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: stopping tablet replica
I20260806 19:28:10.425012 24236 raft_consensus.cc:2229] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:10.425650 24236 raft_consensus.cc:2258] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:10.426780 24237 tablet_replica.cc:330] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: stopping tablet replica
I20260806 19:28:10.427861 24235 ts_tablet_manager.cc:1905] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:10.428704 24237 raft_consensus.cc:2229] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:10.429510 24237 raft_consensus.cc:2258] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:10.432080 24237 ts_tablet_manager.cc:1905] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:10.433879 24236 ts_tablet_manager.cc:1905] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:10.434190 24235 ts_tablet_manager.cc:1918] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 06 19:28:10 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:10.440133 24237 ts_tablet_manager.cc:1918] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:10.440729 24237 log.cc:1196] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/58b1a8c4a8c24f59b86c8ce7c72cdec6
I20260806 19:28:10.441442 24236 ts_tablet_manager.cc:1918] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:10.441483 24237 ts_tablet_manager.cc:1939] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 77955a5cbf7440ba9c1aba6d067d80bc: Deleting consensus metadata
I20260806 19:28:10.441759 24236 log.cc:1196] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/58b1a8c4a8c24f59b86c8ce7c72cdec6
I20260806 19:28:10.442399 24236 ts_tablet_manager.cc:1939] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P feeec911f3a640d69f2907d10d6ecd5c: Deleting consensus metadata
I20260806 19:28:10.443017 24235 log.cc:1196] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/58b1a8c4a8c24f59b86c8ce7c72cdec6
I20260806 19:28:10.443655 24235 ts_tablet_manager.cc:1939] T 58b1a8c4a8c24f59b86c8ce7c72cdec6 P 410bc037193d4efd8aeb4020a9711fc9: Deleting consensus metadata
I20260806 19:28:10.443717 23450 catalog_manager.cc:4841] TS 77955a5cbf7440ba9c1aba6d067d80bc (127.17.18.65:32977): tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (table test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]) successfully deleted
I20260806 19:28:10.445075 23448 catalog_manager.cc:4841] TS feeec911f3a640d69f2907d10d6ecd5c (127.17.18.67:38491): tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (table test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]) successfully deleted
I20260806 19:28:10.445427 23449 catalog_manager.cc:4841] TS 410bc037193d4efd8aeb4020a9711fc9 (127.17.18.66:38859): tablet 58b1a8c4a8c24f59b86c8ce7c72cdec6 (table test-table [id=f11361f2f73249f6b8a8c29d1bb374bf]) successfully deleted
I20260806 19:28:10.446161 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.414510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39410 (local address 127.17.18.65:32977)
0806 19:28:10.414765 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.414772 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.426019 (+ 11247us) server_negotiation.cc:407] Connection header received
0806 19:28:10.426747 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.426755 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.426863 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.426983 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:10.428354 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.429778 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.431666 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.432328 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.432439 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.438333 (+ 5894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:10.438351 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:10.438375 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:10.438432 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:10.442583 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.443571 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.443582 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.443586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.443735 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.444176 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.444182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.444186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.444573 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:10.444867 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.445694 (+ 827us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.445890 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:28:10.446768 23746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:10.601897 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 23555
I20260806 19:28:10.632306 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 23764
Aug 06 19:28:10 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:28:10.651356 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.633324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.17.18.66:38859)
0806 19:28:10.633585 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.633590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.633613 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:28:10.633746 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.633751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.633823 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.633923 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:10.635213 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.635981 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.637850 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.638485 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.638650 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.643368 (+ 4718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:10.643397 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:10.643418 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:10.643500 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:10.647049 (+ 3549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.648235 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.648249 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.648251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.648467 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.649005 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.649011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.649013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.649887 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:10.650412 (+ 525us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.650708 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.650974 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 19:28:10.652297 23945 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:10.772673 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 23764
I20260806 19:28:10.800985 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 23960
Aug 06 19:28:10 dist-test-slave-f0tn krb5kdc[23390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:28:10.817325 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:10.801841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.17.18.67:38491)
0806 19:28:10.802041 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:10.802047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:10.802070 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:28:10.802484 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:10.802489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:10.802582 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:10.802676 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:10.804096 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.804801 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.806217 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:10.806657 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:10.806844 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:10.811489 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:10.811509 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:10.811529 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:10.811572 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:10.814325 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.815084 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.815093 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.815095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.815246 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:10.815663 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:10.815673 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:10.815675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:10.816093 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:10.816411 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:10.816779 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 19:28:10.817014 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:28:10.818106 24158 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:10.910594 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 23960
I20260806 19:28:10.936820 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 23415
I20260806 19:28:10.938104 23513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:11.051843 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 23415
2026-08-06T19:28:11Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4706 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T19:28:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:11Z Disabled control of system clock
I20260806 19:28:11.146157 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43363
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 19:28:11.516623 24252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:11.516973 24252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:11.517078 24252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:11.524757 24252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:11.524891 24252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:11.524942 24252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:11.524999 24252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:11.525044 24252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:11.534842 24252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43363
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:11.536180 24252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:11.538105 24252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:11.551578 24266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:11.551612 24265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:11.551656 24270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:11.552593 24252 server_base.cc:1034] running on GCE node
I20260806 19:28:11.553699 24252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:11.555408 24252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:11.556681 24252 hybrid_clock.cc:648] HybridClock initialized: now 1786044491556609 us; error 49 us; skew 500 ppm
I20260806 19:28:11.557138 24252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:11.559834 24252 webserver.cc:460] Webserver started at http://127.17.18.126:35307/ using document root <none> and password file <none>
I20260806 19:28:11.560654 24252 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:11.560762 24252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:11.561128 24252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:11.564491 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "bf3d8940bfd44a808648139889afc5d3"
format_stamp: "Formatted at 2026-08-06 19:28:11 on dist-test-slave-f0tn"
server_key: "1f20c921f2909b58a5ac2ba4d530f0dd"
server_key_iv: "0305d80fc6b445cdcaecd5a9ce60b960"
server_key_version: "encryptionkey@0"
I20260806 19:28:11.565471 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "bf3d8940bfd44a808648139889afc5d3"
format_stamp: "Formatted at 2026-08-06 19:28:11 on dist-test-slave-f0tn"
server_key: "1f20c921f2909b58a5ac2ba4d530f0dd"
server_key_iv: "0305d80fc6b445cdcaecd5a9ce60b960"
server_key_version: "encryptionkey@0"
I20260806 19:28:11.571604 24252 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260806 19:28:11.575788 24283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:11.577565 24252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:11.577780 24252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "bf3d8940bfd44a808648139889afc5d3"
format_stamp: "Formatted at 2026-08-06 19:28:11 on dist-test-slave-f0tn"
server_key: "1f20c921f2909b58a5ac2ba4d530f0dd"
server_key_iv: "0305d80fc6b445cdcaecd5a9ce60b960"
server_key_version: "encryptionkey@0"
I20260806 19:28:11.578029 24252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:11.584831 24252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:11.585798 24252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:11.586107 24252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:11.606462 24252 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43363
I20260806 19:28:11.606508 24360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43363 every 8 connection(s)
I20260806 19:28:11.607928 24252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:11.612110 24361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:11.614581 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 24252
I20260806 19:28:11.614832 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:11.615638 17481 external_mini_cluster.cc:1428] Setting key 350ae30bd8bab1728f86018eff1adaf7
I20260806 19:28:11.625360 24365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:11.618179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57216 (local address 127.17.18.126:43363)
0806 19:28:11.619414 (+ 1235us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:11.619428 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:11.619474 (+ 46us) server_negotiation.cc:407] Connection header received
0806 19:28:11.621234 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:11.621264 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:11.621819 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:11.622263 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:11.623531 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:11.623546 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:11.623561 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:11.623580 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:11.623643 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:11.623660 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:11.623897 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:11.624043 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 19:28:11.624335 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":426,"threads_started":1}
I20260806 19:28:11.625852 24361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: Bootstrap starting.
I20260806 19:28:11.629371 24361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:11.630537 24361 log.cc:824] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:11.633886 24361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: No bootstrap required, opened a new log
I20260806 19:28:11.642186 24361 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } }
I20260806 19:28:11.642629 24361 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:11.642710 24361 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf3d8940bfd44a808648139889afc5d3, State: Initialized, Role: FOLLOWER
I20260806 19:28:11.643253 24361 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } }
I20260806 19:28:11.643469 24361 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:11.643582 24361 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:11.643723 24361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:11.646430 24361 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } }
I20260806 19:28:11.647039 24361 leader_election.cc:302] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf3d8940bfd44a808648139889afc5d3; no voters:
I20260806 19:28:11.647665 24361 leader_election.cc:288] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:11.647819 24368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:11.649873 24361 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:11.655979 24368 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [term 1 LEADER]: Becoming Leader. State: Replica: bf3d8940bfd44a808648139889afc5d3, State: Running, Role: LEADER
I20260806 19:28:11.656940 24368 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } }
I20260806 19:28:11.660864 24372 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf3d8940bfd44a808648139889afc5d3. Latest consensus state: current_term: 1 leader_uuid: "bf3d8940bfd44a808648139889afc5d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } } }
I20260806 19:28:11.661610 24371 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf3d8940bfd44a808648139889afc5d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf3d8940bfd44a808648139889afc5d3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43363 } } }
I20260806 19:28:11.661984 24372 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:11.661988 24371 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3 [sys.catalog]: This master's current role is: LEADER
W20260806 19:28:11.667009 24392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:28:11.667220 24392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:28:11.667362 24393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:11.669778 24393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:11.680208 24393 catalog_manager.cc:1347] Generated new cluster ID: 68f5c811fee343c3b4ee4b551c9f630b
I20260806 19:28:11.680349 24393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:11.707482 24393 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:11.708003 24393 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:11.716594 24393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: Generated new TSK 0
I20260806 19:28:11.717770 24393 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:28:11.732240 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--builtin_ntp_servers=127.17.18.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 19:28:12.111392 24401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:12.111759 24401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:12.111886 24401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:12.119799 24401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:12.119954 24401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:12.120111 24401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:12.130348 24401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:12.131834 24401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:12.133981 24401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:12.148129 24411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:12.148087 24410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:12.148428 24413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:12.148833 24401 server_base.cc:1034] running on GCE node
I20260806 19:28:12.149718 24401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:12.150899 24401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:12.152149 24401 hybrid_clock.cc:648] HybridClock initialized: now 1786044492152083 us; error 60 us; skew 500 ppm
I20260806 19:28:12.152508 24401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:12.155248 24401 webserver.cc:460] Webserver started at http://127.17.18.65:45635/ using document root <none> and password file <none>
I20260806 19:28:12.156057 24401 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:12.156191 24401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:12.156555 24401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:12.160296 24401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "66fae999dbfa4eb69f0f4f014ed58e52"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "d713111d858d3f98170949a9628c0d44"
server_key_iv: "de8ed0f33f5d011d06da17d92629f743"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.161466 24401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "66fae999dbfa4eb69f0f4f014ed58e52"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "d713111d858d3f98170949a9628c0d44"
server_key_iv: "de8ed0f33f5d011d06da17d92629f743"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.167830 24401 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:12.172508 24419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.174379 24401 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 19:28:12.174600 24401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "66fae999dbfa4eb69f0f4f014ed58e52"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "d713111d858d3f98170949a9628c0d44"
server_key_iv: "de8ed0f33f5d011d06da17d92629f743"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.174872 24401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:12.182303 24401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:12.183341 24401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:12.183655 24401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:12.184823 24401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:12.186641 24401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:12.186756 24401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.186882 24401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:12.186960 24401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.221226 24401 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:34583
I20260806 19:28:12.221307 24595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:34583 every 8 connection(s)
I20260806 19:28:12.222713 24401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:12.230885 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 24401
I20260806 19:28:12.231117 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:12.231916 17481 external_mini_cluster.cc:1428] Setting key fd393b37afa715b23d23638348a6276e
I20260806 19:28:12.232336 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:12.225713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56051 (local address 127.17.18.126:43363)
0806 19:28:12.226228 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:12.226234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:12.227761 (+ 1527us) server_negotiation.cc:407] Connection header received
0806 19:28:12.229593 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:12.229598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:12.229666 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:12.229780 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:12.231418 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:12.231425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:12.231430 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:12.231458 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:12.231530 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:12.231548 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:12.231712 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:12.231900 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 19:28:12.231978 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":229,"threads_started":1}
I20260806 19:28:12.233635 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:12.226421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43363 (local address 127.17.18.65:56051)
0806 19:28:12.227540 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:12.227584 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:12.229224 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:12.230079 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:12.230090 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:12.230248 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:12.230997 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:12.231000 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:12.231049 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:12.231181 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:12.231678 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:12.231690 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:12.231698 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:28:12.231956 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 19:28:12.232275 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":331,"threads_started":1}
I20260806 19:28:12.235438 24596 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43363
I20260806 19:28:12.235481 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--builtin_ntp_servers=127.17.18.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 19:28:12.235818 24596 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:12.236526 24596 heartbeater.cc:511] Master 127.17.18.126:43363 requested a full tablet report, sending...
I20260806 19:28:12.238953 24313 ts_manager.cc:194] Registered new tserver with Master: 66fae999dbfa4eb69f0f4f014ed58e52 (127.17.18.65:34583)
W20260806 19:28:12.593015 24603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:12.593423 24603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:12.593544 24603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:12.601068 24603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:12.601197 24603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:12.601313 24603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:12.611181 24603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:12.612622 24603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:12.614574 24603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:12.628306 24610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:12.628320 24614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:12.628364 24611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:12.629204 24603 server_base.cc:1034] running on GCE node
I20260806 19:28:12.629905 24603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:12.631023 24603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:12.632294 24603 hybrid_clock.cc:648] HybridClock initialized: now 1786044492632228 us; error 50 us; skew 500 ppm
I20260806 19:28:12.632673 24603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:12.635624 24603 webserver.cc:460] Webserver started at http://127.17.18.66:37567/ using document root <none> and password file <none>
I20260806 19:28:12.636427 24603 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:12.636533 24603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:12.636886 24603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:12.640094 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "5a8717c6553c4dea950ef65e7d5e2e43"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "2118ac472b8d39fbdd3b82dc45538b49"
server_key_iv: "7e742dab3c42932d52274d77d189d2d9"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.640964 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "5a8717c6553c4dea950ef65e7d5e2e43"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "2118ac472b8d39fbdd3b82dc45538b49"
server_key_iv: "7e742dab3c42932d52274d77d189d2d9"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.648089 24603 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260806 19:28:12.652285 24624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.653839 24603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:12.654023 24603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "5a8717c6553c4dea950ef65e7d5e2e43"
format_stamp: "Formatted at 2026-08-06 19:28:12 on dist-test-slave-f0tn"
server_key: "2118ac472b8d39fbdd3b82dc45538b49"
server_key_iv: "7e742dab3c42932d52274d77d189d2d9"
server_key_version: "encryptionkey@0"
I20260806 19:28:12.654273 24603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:12.660935 24603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:12.661968 24603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:12.662238 24603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:12.663234 24603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:12.664820 24603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:12.664920 24603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.665031 24603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:12.665102 24603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:12.698697 24603 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:34099
I20260806 19:28:12.698737 24796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:34099 every 8 connection(s)
I20260806 19:28:12.700137 24603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:12.701514 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 24603
I20260806 19:28:12.701732 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:12.702193 17481 external_mini_cluster.cc:1428] Setting key 0b32866d01a713d1f711a8f66f79a163
I20260806 19:28:12.705704 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--builtin_ntp_servers=127.17.18.84:33099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 19:28:12.710350 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:12.702922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:53197 (local address 127.17.18.126:43363)
0806 19:28:12.703115 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:12.703121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:12.705063 (+ 1942us) server_negotiation.cc:407] Connection header received
0806 19:28:12.707642 (+ 2579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:12.707647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:12.707755 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:12.707861 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:12.709607 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:12.709613 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:12.709617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:12.709639 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:12.709678 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:12.709691 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:12.709817 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:12.710047 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 19:28:12.710113 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 19:28:12.711822 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:12.703666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43363 (local address 127.17.18.66:53197)
0806 19:28:12.704871 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:12.704931 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:12.707175 (+ 2244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:12.708183 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:12.708197 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:12.708338 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:12.709137 (+ 799us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:12.709140 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:12.709202 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:12.709337 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:12.709798 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:12.709808 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:12.709816 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:28:12.710126 (+ 310us) client_negotiation.cc:240] Negotiation successful
0806 19:28:12.710499 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":377,"threads_started":1}
I20260806 19:28:12.713465 24797 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43363
I20260806 19:28:12.713819 24797 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:12.714483 24797 heartbeater.cc:511] Master 127.17.18.126:43363 requested a full tablet report, sending...
I20260806 19:28:12.716146 24313 ts_manager.cc:194] Registered new tserver with Master: 5a8717c6553c4dea950ef65e7d5e2e43 (127.17.18.66:34099)
W20260806 19:28:13.057281 24801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:13.057688 24801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:13.057788 24801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:13.065666 24801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:13.065790 24801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:13.065905 24801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:13.075508 24801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:13.076880 24801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:13.078868 24801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:13.092746 24808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:13.093014 24807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:13.093885 24812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:13.095041 24801 server_base.cc:1034] running on GCE node
I20260806 19:28:13.095763 24801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:13.097162 24801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:13.098424 24801 hybrid_clock.cc:648] HybridClock initialized: now 1786044493098357 us; error 62 us; skew 500 ppm
I20260806 19:28:13.098855 24801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:13.101773 24801 webserver.cc:460] Webserver started at http://127.17.18.67:41443/ using document root <none> and password file <none>
I20260806 19:28:13.102608 24801 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:13.102728 24801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:13.103127 24801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:13.106719 24801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "7c21f50da2ba469d9994ddbfe28a70f4"
format_stamp: "Formatted at 2026-08-06 19:28:13 on dist-test-slave-f0tn"
server_key: "2c2171558634d46204e944c1ed4c1f69"
server_key_iv: "2192d2161b1bbd9d0cbeef195a4dddb3"
server_key_version: "encryptionkey@0"
I20260806 19:28:13.107767 24801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "7c21f50da2ba469d9994ddbfe28a70f4"
format_stamp: "Formatted at 2026-08-06 19:28:13 on dist-test-slave-f0tn"
server_key: "2c2171558634d46204e944c1ed4c1f69"
server_key_iv: "2192d2161b1bbd9d0cbeef195a4dddb3"
server_key_version: "encryptionkey@0"
I20260806 19:28:13.113984 24801 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 19:28:13.118067 24820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:13.119845 24801 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260806 19:28:13.120153 24801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "7c21f50da2ba469d9994ddbfe28a70f4"
format_stamp: "Formatted at 2026-08-06 19:28:13 on dist-test-slave-f0tn"
server_key: "2c2171558634d46204e944c1ed4c1f69"
server_key_iv: "2192d2161b1bbd9d0cbeef195a4dddb3"
server_key_version: "encryptionkey@0"
I20260806 19:28:13.120434 24801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:13.127068 24801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:13.128151 24801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:13.128520 24801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:13.129705 24801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:13.131533 24801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:13.131649 24801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:13.131788 24801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:13.131863 24801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:13.165908 24801 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43603
I20260806 19:28:13.165977 24984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43603 every 8 connection(s)
I20260806 19:28:13.167382 24801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:13.173105 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 24801
I20260806 19:28:13.173283 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:13.173805 17481 external_mini_cluster.cc:1428] Setting key 060b5b7fac1efe482ec36eebc7663543
I20260806 19:28:13.177042 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.170401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:52935 (local address 127.17.18.126:43363)
0806 19:28:13.170607 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.170611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.172167 (+ 1556us) server_negotiation.cc:407] Connection header received
0806 19:28:13.174150 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.174156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.174237 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.174367 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.176151 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.176157 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.176162 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.176184 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.176234 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.176252 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.176392 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.176635 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.176736 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 19:28:13.178156 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.170912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43363 (local address 127.17.18.67:52935)
0806 19:28:13.171950 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.171990 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.173792 (+ 1802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.174750 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.174761 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.174874 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.175748 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.175751 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.175806 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.175914 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.176403 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.176413 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.176420 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.176676 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.176937 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":306,"threads_started":1}
I20260806 19:28:13.180011 24985 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43363
I20260806 19:28:13.180613 24985 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:13.181356 24985 heartbeater.cc:511] Master 127.17.18.126:43363 requested a full tablet report, sending...
I20260806 19:28:13.183248 24313 ts_manager.cc:194] Registered new tserver with Master: 7c21f50da2ba469d9994ddbfe28a70f4 (127.17.18.67:43603)
I20260806 19:28:13.190974 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:28:13.198477 24601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.195903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.17.18.126:43363)
0806 19:28:13.196089 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.196094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.196577 (+ 483us) server_negotiation.cc:407] Connection header received
0806 19:28:13.196786 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.196791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.196857 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.196958 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.197939 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.197944 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.197947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.197964 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.198000 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.198013 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.198131 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.198178 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.198239 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:28:13.203438 24313 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:13.211761 24313 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:13.234862 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.227878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43603 (local address 127.0.0.1:52088)
0806 19:28:13.229773 (+ 1895us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.229795 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.229914 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.231997 (+ 2083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.232001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.232026 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.233248 (+ 1222us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.233252 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.233270 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.233319 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.233977 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.233990 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.233998 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.234189 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.234310 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1746,"thread_start_us":457,"threads_started":1}
I20260806 19:28:13.235754 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.228549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52088 (local address 127.17.18.67:43603)
0806 19:28:13.230145 (+ 1596us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.230155 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.230197 (+ 42us) server_negotiation.cc:407] Connection header received
0806 19:28:13.230276 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.230285 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.230575 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.230756 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.233567 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.233579 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.233596 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.233619 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.233705 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.233730 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.233911 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.235279 (+ 1368us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.235366 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1136,"thread_start_us":1063,"threads_started":1}
I20260806 19:28:13.234906 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.227603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33136)
0806 19:28:13.228966 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.229034 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.229225 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.230821 (+ 1596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.230829 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.230929 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.232510 (+ 1581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.232513 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.232546 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.232632 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.234333 (+ 1701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.234337 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.234342 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.234473 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.234523 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"thread_start_us":1893,"threads_started":1}
I20260806 19:28:13.237639 25002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.228302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33136 (local address 127.17.18.65:34583)
0806 19:28:13.230319 (+ 2017us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.230327 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.230352 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:28:13.230412 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.230419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.230572 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.231470 (+ 898us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.234067 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.234075 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.234088 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.234107 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.234185 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.234211 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.235098 (+ 887us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.235192 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.235316 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1829,"thread_start_us":1800,"threads_started":1}
I20260806 19:28:13.242504 24596 heartbeater.cc:503] Master 127.17.18.126:43363 was elected leader, sending a full tablet report...
I20260806 19:28:13.241324 24889 tablet_service.cc:1467] Processing CreateTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 (DEFAULT_TABLE table=test-table [id=113ac75936a64b13b8fa2fe50503c58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:13.244225 24889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf5a1c20c7dc43b5859c16109c19bfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:13.246003 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.229984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:34099 (local address 127.0.0.1:44820)
0806 19:28:13.236173 (+ 6189us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.236192 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.236282 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.243586 (+ 7304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.243591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.243655 (+ 64us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.244305 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.244309 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.244329 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.244386 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.245413 (+ 1027us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.245418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.245423 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.245642 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.245715 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6092,"thread_start_us":12382,"threads_started":1}
I20260806 19:28:13.246526 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.230328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44820 (local address 127.17.18.66:34099)
0806 19:28:13.242989 (+ 12661us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.242998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.243033 (+ 35us) server_negotiation.cc:407] Connection header received
0806 19:28:13.243110 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.243119 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.243378 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.244009 (+ 631us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.245173 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.245179 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.245190 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.245209 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.245247 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.245260 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.245423 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.245683 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.245790 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12499,"thread_start_us":12376,"threads_started":1}
I20260806 19:28:13.247324 24492 tablet_service.cc:1467] Processing CreateTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 (DEFAULT_TABLE table=test-table [id=113ac75936a64b13b8fa2fe50503c58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:13.248986 24492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf5a1c20c7dc43b5859c16109c19bfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:13.250290 24704 tablet_service.cc:1467] Processing CreateTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 (DEFAULT_TABLE table=test-table [id=113ac75936a64b13b8fa2fe50503c58b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:13.251602 24704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf5a1c20c7dc43b5859c16109c19bfa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:13.264138 25011 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Bootstrap starting.
I20260806 19:28:13.265476 25009 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Bootstrap starting.
I20260806 19:28:13.269644 25009 tablet_bootstrap.cc:654] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:13.269644 25011 tablet_bootstrap.cc:654] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:13.271093 25011 log.cc:824] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:13.271093 25009 log.cc:824] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:13.271379 25012 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Bootstrap starting.
I20260806 19:28:13.275419 25009 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: No bootstrap required, opened a new log
I20260806 19:28:13.275419 25011 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: No bootstrap required, opened a new log
I20260806 19:28:13.275437 25012 tablet_bootstrap.cc:654] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:13.275753 25011 ts_tablet_manager.cc:1397] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260806 19:28:13.275753 25009 ts_tablet_manager.cc:1397] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 19:28:13.276556 25012 log.cc:824] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:13.279415 25012 tablet_bootstrap.cc:492] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: No bootstrap required, opened a new log
I20260806 19:28:13.279732 25012 ts_tablet_manager.cc:1397] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 19:28:13.286873 25011 raft_consensus.cc:348] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.286890 25009 raft_consensus.cc:348] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.287434 25009 raft_consensus.cc:374] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:13.287569 25009 raft_consensus.cc:729] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c21f50da2ba469d9994ddbfe28a70f4, State: Initialized, Role: FOLLOWER
I20260806 19:28:13.287619 25011 raft_consensus.cc:374] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:13.287729 25011 raft_consensus.cc:729] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a8717c6553c4dea950ef65e7d5e2e43, State: Initialized, Role: FOLLOWER
I20260806 19:28:13.288084 25012 raft_consensus.cc:348] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.288481 25012 raft_consensus.cc:374] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:13.288583 25012 raft_consensus.cc:729] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66fae999dbfa4eb69f0f4f014ed58e52, State: Initialized, Role: FOLLOWER
I20260806 19:28:13.288419 25009 consensus_queue.cc:260] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.288419 25011 consensus_queue.cc:260] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.289394 25012 consensus_queue.cc:260] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.290356 24985 heartbeater.cc:503] Master 127.17.18.126:43363 was elected leader, sending a full tablet report...
I20260806 19:28:13.290421 24797 heartbeater.cc:503] Master 127.17.18.126:43363 was elected leader, sending a full tablet report...
I20260806 19:28:13.290966 25009 ts_tablet_manager.cc:1428] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 19:28:13.292248 25011 ts_tablet_manager.cc:1428] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Time spent starting tablet: real 0.016s user 0.016s sys 0.001s
I20260806 19:28:13.294932 25012 ts_tablet_manager.cc:1428] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 19:28:13.385831 25021 raft_consensus.cc:482] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:13.386165 25021 raft_consensus.cc:504] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.388128 25021 leader_election.cc:288] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c21f50da2ba469d9994ddbfe28a70f4 (127.17.18.67:43603), 5a8717c6553c4dea950ef65e7d5e2e43 (127.17.18.66:34099)
I20260806 19:28:13.391606 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.388623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:54989 (local address 127.17.18.67:43603)
0806 19:28:13.388805 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.388810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.389273 (+ 463us) server_negotiation.cc:407] Connection header received
0806 19:28:13.389458 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.389463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.389521 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.389631 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.390947 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.390953 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.390958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.390981 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.391023 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.391040 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.391209 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.391264 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.391332 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 19:28:13.391613 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.388498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:57251 (local address 127.17.18.66:34099)
0806 19:28:13.388749 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.388757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.389314 (+ 557us) server_negotiation.cc:407] Connection header received
0806 19:28:13.389445 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.389450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.389521 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.389631 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.390947 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.390953 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.390958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.390981 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.391033 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.391052 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.391167 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.391276 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.391335 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 19:28:13.391896 25026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.388371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43603 (local address 127.17.18.65:54989)
0806 19:28:13.389137 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.389158 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.389301 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.389727 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.389735 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.389766 (+ 31us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.390698 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.390701 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.390722 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.390778 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.391149 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.391155 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.391160 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.391308 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.391376 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":379,"threads_started":1}
I20260806 19:28:13.391947 25025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.388371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:34099 (local address 127.17.18.65:57251)
0806 19:28:13.389207 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.389226 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:13.389309 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:13.389727 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:13.389735 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:13.389766 (+ 31us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:13.390726 (+ 960us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:28:13.390729 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:13.390740 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:28:13.390777 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:13.391154 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:13.391158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:13.391162 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 19:28:13.391347 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 19:28:13.391384 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":739,"mutex_wait_us":36,"thread_start_us":555,"threads_started":1}
I20260806 19:28:13.392974 24916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf5a1c20c7dc43b5859c16109c19bfa1" candidate_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" is_pre_election: true
I20260806 19:28:13.392961 24730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf5a1c20c7dc43b5859c16109c19bfa1" candidate_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" is_pre_election: true
I20260806 19:28:13.393532 24730 raft_consensus.cc:2454] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66fae999dbfa4eb69f0f4f014ed58e52 in term 0.
I20260806 19:28:13.393530 24916 raft_consensus.cc:2454] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66fae999dbfa4eb69f0f4f014ed58e52 in term 0.
I20260806 19:28:13.394246 24427 leader_election.cc:302] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fae999dbfa4eb69f0f4f014ed58e52, 7c21f50da2ba469d9994ddbfe28a70f4; no voters:
I20260806 19:28:13.394615 25021 raft_consensus.cc:2781] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:13.394768 25021 raft_consensus.cc:482] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:13.394871 25021 raft_consensus.cc:3037] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:13.397141 25021 raft_consensus.cc:504] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.397886 25021 leader_election.cc:288] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [CANDIDATE]: Term 1 election: Requested vote from peers 7c21f50da2ba469d9994ddbfe28a70f4 (127.17.18.67:43603), 5a8717c6553c4dea950ef65e7d5e2e43 (127.17.18.66:34099)
I20260806 19:28:13.398465 24916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf5a1c20c7dc43b5859c16109c19bfa1" candidate_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c21f50da2ba469d9994ddbfe28a70f4"
I20260806 19:28:13.398492 24730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf5a1c20c7dc43b5859c16109c19bfa1" candidate_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a8717c6553c4dea950ef65e7d5e2e43"
I20260806 19:28:13.398717 24916 raft_consensus.cc:3037] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:13.398717 24730 raft_consensus.cc:3037] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:13.402310 24916 raft_consensus.cc:2454] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fae999dbfa4eb69f0f4f014ed58e52 in term 1.
I20260806 19:28:13.402310 24730 raft_consensus.cc:2454] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fae999dbfa4eb69f0f4f014ed58e52 in term 1.
I20260806 19:28:13.402990 24424 leader_election.cc:302] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a8717c6553c4dea950ef65e7d5e2e43, 66fae999dbfa4eb69f0f4f014ed58e52; no voters:
I20260806 19:28:13.403503 25021 raft_consensus.cc:2781] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:13.403999 25021 raft_consensus.cc:686] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 1 LEADER]: Becoming Leader. State: Replica: 66fae999dbfa4eb69f0f4f014ed58e52, State: Running, Role: LEADER
I20260806 19:28:13.404577 25021 consensus_queue.cc:237] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } }
I20260806 19:28:13.409514 24313 catalog_manager.cc:5495] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66fae999dbfa4eb69f0f4f014ed58e52 (127.17.18.65). New cstate: current_term: 1 leader_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fae999dbfa4eb69f0f4f014ed58e52" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 } health_report { overall_health: UNKNOWN } } }
W20260806 19:28:13.419278 24986 tablet.cc:2369] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:13.435158 25002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.432922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33150 (local address 127.17.18.65:34583)
0806 19:28:13.433152 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.433157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.433177 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:28:13.433281 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.433294 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.433430 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.433539 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.434415 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.434420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.434424 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.434440 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.434475 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.434487 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.434603 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.434739 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.434793 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 19:28:13.444228 24730 raft_consensus.cc:1261] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 1 FOLLOWER]: Refusing update from remote peer 66fae999dbfa4eb69f0f4f014ed58e52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:13.444231 24916 raft_consensus.cc:1261] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 1 FOLLOWER]: Refusing update from remote peer 66fae999dbfa4eb69f0f4f014ed58e52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:13.445299 25027 consensus_queue.cc:1035] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a8717c6553c4dea950ef65e7d5e2e43" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:13.445747 25021 consensus_queue.cc:1035] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c21f50da2ba469d9994ddbfe28a70f4" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:28:13.452272 24798 tablet.cc:2369] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:13.477954 24310 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:13.478260 24310 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:13.482734 24310 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf3d8940bfd44a808648139889afc5d3: Sending DeleteTablet for 3 replicas of tablet cf5a1c20c7dc43b5859c16109c19bfa1
I20260806 19:28:13.484182 24492 tablet_service.cc:1514] Processing DeleteTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:13 UTC) from {username='slave'} at 127.0.0.1:33136
I20260806 19:28:13.484558 24704 tablet_service.cc:1514] Processing DeleteTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:13 UTC) from {username='slave'} at 127.0.0.1:44820
I20260806 19:28:13.484980 24889 tablet_service.cc:1514] Processing DeleteTablet for tablet cf5a1c20c7dc43b5859c16109c19bfa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:13 UTC) from {username='slave'} at 127.0.0.1:52088
I20260806 19:28:13.485890 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 24401
I20260806 19:28:13.494001 25050 tablet_replica.cc:330] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: stopping tablet replica
I20260806 19:28:13.494626 25050 raft_consensus.cc:2229] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:13.495270 25050 raft_consensus.cc:2258] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:13.497299 25048 tablet_replica.cc:330] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: stopping tablet replica
I20260806 19:28:13.497947 25048 raft_consensus.cc:2229] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:13.498785 25048 raft_consensus.cc:2258] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:13.499207 25049 tablet_replica.cc:330] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: stopping tablet replica
I20260806 19:28:13.499747 25049 raft_consensus.cc:2229] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:13.500391 25049 raft_consensus.cc:2258] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:13.500972 25002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.487679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33156 (local address 127.17.18.65:34583)
0806 19:28:13.487888 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.487894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.498277 (+ 10383us) server_negotiation.cc:407] Connection header received
0806 19:28:13.498531 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.498537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.498624 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.498752 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.500086 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.500093 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.500098 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.500123 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.500166 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.500184 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.500308 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.500580 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.500651 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 19:28:13.501573 25048 ts_tablet_manager.cc:1905] T cf5a1c20c7dc43b5859c16109c19bfa1 P 66fae999dbfa4eb69f0f4f014ed58e52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:13.502476 24590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:13.503492 25049 ts_tablet_manager.cc:1905] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:13.504681 25050 ts_tablet_manager.cc:1905] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:13.511456 25049 ts_tablet_manager.cc:1918] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:13.511677 25049 log.cc:1196] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/cf5a1c20c7dc43b5859c16109c19bfa1
I20260806 19:28:13.512084 25050 ts_tablet_manager.cc:1918] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:13.512270 25050 log.cc:1196] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/cf5a1c20c7dc43b5859c16109c19bfa1
I20260806 19:28:13.512297 25049 ts_tablet_manager.cc:1939] T cf5a1c20c7dc43b5859c16109c19bfa1 P 5a8717c6553c4dea950ef65e7d5e2e43: Deleting consensus metadata
I20260806 19:28:13.512717 25050 ts_tablet_manager.cc:1939] T cf5a1c20c7dc43b5859c16109c19bfa1 P 7c21f50da2ba469d9994ddbfe28a70f4: Deleting consensus metadata
I20260806 19:28:13.514431 24289 catalog_manager.cc:4841] TS 5a8717c6553c4dea950ef65e7d5e2e43 (127.17.18.66:34099): tablet cf5a1c20c7dc43b5859c16109c19bfa1 (table test-table [id=113ac75936a64b13b8fa2fe50503c58b]) successfully deleted
I20260806 19:28:13.514384 24291 catalog_manager.cc:4841] TS 7c21f50da2ba469d9994ddbfe28a70f4 (127.17.18.67:43603): tablet cf5a1c20c7dc43b5859c16109c19bfa1 (table test-table [id=113ac75936a64b13b8fa2fe50503c58b]) successfully deleted
I20260806 19:28:13.603871 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 24401
W20260806 19:28:13.638312 24289 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.18.65:34583 (error 108)
I20260806 19:28:13.638578 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 24603
I20260806 19:28:13.640709 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.639930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33168)
0806 19:28:13.640251 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.640496 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260806 19:28:13.641047 24289 catalog_manager.cc:4584] TS 66fae999dbfa4eb69f0f4f014ed58e52 (127.17.18.65:34583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cf5a1c20c7dc43b5859c16109c19bfa1: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
I20260806 19:28:13.642067 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.639371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44826 (local address 127.17.18.66:34099)
0806 19:28:13.639637 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.639656 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.639682 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:28:13.639851 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.639857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.639989 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.640115 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.641227 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.641234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.641238 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.641261 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.641306 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.641322 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.641611 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.641730 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.641803 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:28:13.642736 24788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:13.695183 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.694586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33170)
0806 19:28:13.694874 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.694988 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 19:28:13.696359 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.695925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33182)
0806 19:28:13.696091 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.696195 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 19:28:13.732481 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 24603
I20260806 19:28:13.757010 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.756392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33196)
0806 19:28:13.756650 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.756799 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 19:28:13.758234 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.757820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33200)
0806 19:28:13.757992 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.758085 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 19:28:13.760120 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 24801
I20260806 19:28:13.763239 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.760906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.17.18.67:43603)
0806 19:28:13.761118 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:13.761124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:13.761192 (+ 68us) server_negotiation.cc:407] Connection header received
0806 19:28:13.761462 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:13.761466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:13.761557 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:13.761648 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:13.762564 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:13.762569 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:13.762573 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:13.762589 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:13.762624 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:13.762636 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:13.762778 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:13.762884 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 19:28:13.762952 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:28:13.763897 24979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:13.839367 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.838865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33212)
0806 19:28:13.839116 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.839213 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 19:28:13.840595 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:13.840144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34583 (local address 127.0.0.1:33226)
0806 19:28:13.840359 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:13.840444 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:34583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260806 19:28:13.854274 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 24801
I20260806 19:28:13.880053 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 24252
I20260806 19:28:13.881315 24353 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:13.993827 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 24252
2026-08-06T19:28:14Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2939 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 19:28:14.048467 17481 mini_oidc.cc:152] Starting JWKS server
I20260806 19:28:14.051810 17481 webserver.cc:460] Webserver started at https://127.0.0.1:44253/ using document root <none> and password file <none>
I20260806 19:28:14.052217 17481 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 19:28:14.052994 17481 webserver.cc:460] Webserver started at http://127.0.0.1:36593/ using document root <none> and password file <none>
2026-08-06T19:28:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:14Z Disabled control of system clock
I20260806 19:28:14.091075 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45877
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:35551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45877
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44253/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/testchainca.cert with env {}
W20260806 19:28:14.464468 25066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:14.464831 25066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:14.464973 25066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:14.472774 25066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:14.472923 25066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:14.472994 25066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:14.473084 25066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:14.473145 25066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 19:28:14.473234 25066 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 19:28:14.473286 25066 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44253/jwks.json
I20260806 19:28:14.484055 25066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:35551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45877
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44253/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:14.485595 25066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:14.487012 25066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:14.499588 25080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:14.499648 25075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:14.499614 25077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:14.500888 25066 server_base.cc:1034] running on GCE node
I20260806 19:28:14.501816 25066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:14.503366 25066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:14.504599 25066 hybrid_clock.cc:648] HybridClock initialized: now 1786044494504540 us; error 48 us; skew 500 ppm
I20260806 19:28:14.505005 25066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:14.510855 25066 webserver.cc:460] Webserver started at http://127.17.18.126:37401/ using document root <none> and password file <none>
I20260806 19:28:14.511752 25066 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:14.511879 25066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:14.512291 25066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:14.515781 25066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "ad84911611634534ab68bfda14871505"
format_stamp: "Formatted at 2026-08-06 19:28:14 on dist-test-slave-f0tn"
server_key: "7c91bd518a5dfd0bddd86e908e44910b"
server_key_iv: "15309874ebb15a33f109ea932b9197c0"
server_key_version: "encryptionkey@0"
I20260806 19:28:14.516912 25066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "ad84911611634534ab68bfda14871505"
format_stamp: "Formatted at 2026-08-06 19:28:14 on dist-test-slave-f0tn"
server_key: "7c91bd518a5dfd0bddd86e908e44910b"
server_key_iv: "15309874ebb15a33f109ea932b9197c0"
server_key_version: "encryptionkey@0"
I20260806 19:28:14.522907 25066 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 19:28:14.527055 25088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:14.528690 25066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260806 19:28:14.528884 25066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "ad84911611634534ab68bfda14871505"
format_stamp: "Formatted at 2026-08-06 19:28:14 on dist-test-slave-f0tn"
server_key: "7c91bd518a5dfd0bddd86e908e44910b"
server_key_iv: "15309874ebb15a33f109ea932b9197c0"
server_key_version: "encryptionkey@0"
I20260806 19:28:14.529151 25066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:14.543077 25066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:14.544015 25066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:14.544327 25066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:14.563886 25066 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45877
I20260806 19:28:14.563905 25165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45877 every 8 connection(s)
I20260806 19:28:14.565442 25066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:14.568450 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25066
I20260806 19:28:14.568655 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:14.569324 17481 external_mini_cluster.cc:1428] Setting key 56bb977ba077d721f7f244baa46ebb21
I20260806 19:28:14.570261 25166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:14.586866 25166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505: Bootstrap starting.
I20260806 19:28:14.587265 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:14.571659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.17.18.126:45877)
0806 19:28:14.572853 (+ 1194us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:14.572870 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:14.572930 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:28:14.575429 (+ 2499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:14.575475 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:14.576275 (+ 800us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:14.576842 (+ 567us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:14.577522 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.579563 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.581181 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.582319 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.582536 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:14.583952 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:14.583971 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:14.583999 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:14.584851 (+ 852us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:14.584961 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:14.584991 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:14.585109 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:14.585445 (+ 336us) server_negotiation.cc:299] Negotiation successful
0806 19:28:14.585835 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":388,"threads_started":1}
I20260806 19:28:14.590972 25166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:14.592332 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:28:14.592383 25166 log.cc:824] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:14.596045 25166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505: No bootstrap required, opened a new log
I20260806 19:28:14.604033 25166 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } }
I20260806 19:28:14.604485 25166 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:14.604591 25166 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84911611634534ab68bfda14871505, State: Initialized, Role: FOLLOWER
I20260806 19:28:14.605278 25166 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } }
I20260806 19:28:14.605582 25166 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:14.605733 25166 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:14.605899 25166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:14.608451 25166 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } }
I20260806 19:28:14.609030 25166 leader_election.cc:302] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad84911611634534ab68bfda14871505; no voters:
I20260806 19:28:14.609685 25166 leader_election.cc:288] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:14.609818 25172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:14.610620 25172 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [term 1 LEADER]: Becoming Leader. State: Replica: ad84911611634534ab68bfda14871505, State: Running, Role: LEADER
I20260806 19:28:14.611157 25172 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } }
I20260806 19:28:14.611912 25166 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:14.614185 25173 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad84911611634534ab68bfda14871505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } } }
I20260806 19:28:14.614660 25173 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:14.614954 25174 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad84911611634534ab68bfda14871505. Latest consensus state: current_term: 1 leader_uuid: "ad84911611634534ab68bfda14871505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad84911611634534ab68bfda14871505" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45877 } } }
I20260806 19:28:14.616823 25174 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:14.623032 25181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:14.628902 25181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:14.638933 25181 catalog_manager.cc:1347] Generated new cluster ID: 31ecb73ae0ef4fe483bcc220871beb49
I20260806 19:28:14.639081 25181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:14.663682 25181 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:14.665940 25181 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:14.680007 25181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad84911611634534ab68bfda14871505: Generated new TSK 0
I20260806 19:28:14.681252 25181 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 19:28:14.729969 25203 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 19:28:14.730235 25203 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 19:28:14.731280 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:14.707827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57362 (local address 127.17.18.126:45877)
0806 19:28:14.708062 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:14.708071 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:14.708705 (+ 634us) server_negotiation.cc:407] Connection header received
0806 19:28:14.709149 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:14.709154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:14.709249 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:14.709456 (+ 207us) server_negotiation.cc:226] Negotiated authn=JWT
0806 19:28:14.710117 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.710876 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.713159 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.713718 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.713836 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:14.714577 (+ 741us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 19:28:14.730683 (+ 16106us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 19:28:14.731020 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57362: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 19:28:14.731405 25169 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57362: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 19:28:14.734165 25202 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:14.707796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45877 (local address 127.0.0.1:57362)
0806 19:28:14.708559 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:14.708582 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:14.708820 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:14.709493 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:14.709499 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:14.709513 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 19:28:14.709952 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:14.709967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.711023 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.711029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:14.712965 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:14.712983 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:14.713924 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:14.713932 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:14.714129 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:14.714224 (+ 95us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 19:28:14.731029 (+ 16805us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 19:28:14.731432 (+ 403us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.18.126:45877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":370,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.18.126:45877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 19:28:14.735755 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25066
I20260806 19:28:14.737144 25160 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:14.835808 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25066
2026-08-06T19:28:14Z chronyd exiting
I20260806 19:28:14.893736 17481 test_util.cc:175] -----------------------------------------------
I20260806 19:28:14.893879 17481 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786044445493736-17481-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (850 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 19:28:14.898033 17481 mini_oidc.cc:152] Starting JWKS server
I20260806 19:28:14.899945 17481 webserver.cc:460] Webserver started at https://127.0.0.1:40301/ using document root <none> and password file <none>
I20260806 19:28:14.900223 17481 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 19:28:14.900918 17481 webserver.cc:460] Webserver started at http://127.0.0.1:42451/ using document root <none> and password file <none>
2026-08-06T19:28:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:14Z Disabled control of system clock
I20260806 19:28:14.937813 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34321
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:39291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:34321
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40301/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/testchainca.cert with env {}
W20260806 19:28:15.300680 25216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:15.301050 25216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:15.301209 25216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:15.308840 25216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:15.308990 25216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:15.309062 25216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:15.309144 25216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:15.309207 25216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 19:28:15.309297 25216 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 19:28:15.309352 25216 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40301/jwks.json
I20260806 19:28:15.320304 25216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:34321
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:34321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40301/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:15.321779 25216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:15.323199 25216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:15.336259 25223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:15.336287 25222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:15.336609 25226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:15.337067 25216 server_base.cc:1034] running on GCE node
I20260806 19:28:15.338012 25216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:15.339716 25216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:15.340967 25216 hybrid_clock.cc:648] HybridClock initialized: now 1786044495340912 us; error 40 us; skew 500 ppm
I20260806 19:28:15.341413 25216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:15.344190 25216 webserver.cc:460] Webserver started at http://127.17.18.126:38613/ using document root <none> and password file <none>
I20260806 19:28:15.345017 25216 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:15.345126 25216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:15.345530 25216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:15.348757 25216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "d9158740b7b447f19db1eb6c7ee682ea"
format_stamp: "Formatted at 2026-08-06 19:28:15 on dist-test-slave-f0tn"
server_key: "60d7282023ac096c210b3ed8744ba6cb"
server_key_iv: "2e3e2f7b0514f36a833326c5ce174ee4"
server_key_version: "encryptionkey@0"
I20260806 19:28:15.349725 25216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "d9158740b7b447f19db1eb6c7ee682ea"
format_stamp: "Formatted at 2026-08-06 19:28:15 on dist-test-slave-f0tn"
server_key: "60d7282023ac096c210b3ed8744ba6cb"
server_key_iv: "2e3e2f7b0514f36a833326c5ce174ee4"
server_key_version: "encryptionkey@0"
I20260806 19:28:15.355789 25216 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:15.360028 25234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:15.362047 25216 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:15.362305 25216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "d9158740b7b447f19db1eb6c7ee682ea"
format_stamp: "Formatted at 2026-08-06 19:28:15 on dist-test-slave-f0tn"
server_key: "60d7282023ac096c210b3ed8744ba6cb"
server_key_iv: "2e3e2f7b0514f36a833326c5ce174ee4"
server_key_version: "encryptionkey@0"
I20260806 19:28:15.362563 25216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:15.387061 25216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:15.388077 25216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:15.388424 25216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:15.409862 25216 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:34321
I20260806 19:28:15.409837 25311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:34321 every 8 connection(s)
I20260806 19:28:15.411645 25216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:15.414227 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25216
I20260806 19:28:15.414424 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:15.415141 17481 external_mini_cluster.cc:1428] Setting key 4afd020a098623460b2114f25e618ce1
I20260806 19:28:15.416214 25312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:15.431512 25312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea: Bootstrap starting.
I20260806 19:28:15.434031 25317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:15.417240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55312 (local address 127.17.18.126:34321)
0806 19:28:15.422348 (+ 5108us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:15.422362 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:15.422419 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:28:15.424223 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:15.424257 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:15.424895 (+ 638us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:15.425359 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:15.426202 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.427556 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.429024 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.429859 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.430056 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:15.431406 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:15.431416 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:15.431435 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:15.432063 (+ 628us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:15.432176 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:15.432202 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:15.432326 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:15.432580 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 19:28:15.432925 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4509,"thread_start_us":4191,"threads_started":1}
I20260806 19:28:15.435428 25312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:15.436596 25312 log.cc:824] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:15.438788 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:28:15.439953 25312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea: No bootstrap required, opened a new log
I20260806 19:28:15.448052 25312 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } }
I20260806 19:28:15.448472 25312 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:15.448577 25312 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9158740b7b447f19db1eb6c7ee682ea, State: Initialized, Role: FOLLOWER
I20260806 19:28:15.449160 25312 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } }
I20260806 19:28:15.449486 25312 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:15.449613 25312 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:15.449781 25312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:15.452064 25312 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } }
I20260806 19:28:15.452620 25312 leader_election.cc:302] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9158740b7b447f19db1eb6c7ee682ea; no voters:
I20260806 19:28:15.453346 25312 leader_election.cc:288] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:15.453508 25322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:15.454243 25322 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [term 1 LEADER]: Becoming Leader. State: Replica: d9158740b7b447f19db1eb6c7ee682ea, State: Running, Role: LEADER
I20260806 19:28:15.454819 25322 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } }
I20260806 19:28:15.455569 25312 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:15.457827 25329 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9158740b7b447f19db1eb6c7ee682ea. Latest consensus state: current_term: 1 leader_uuid: "d9158740b7b447f19db1eb6c7ee682ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } } }
I20260806 19:28:15.458278 25329 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:15.458039 25328 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9158740b7b447f19db1eb6c7ee682ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9158740b7b447f19db1eb6c7ee682ea" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 34321 } } }
I20260806 19:28:15.458403 25328 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:15.460139 25338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:15.465209 25338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:15.475529 25338 catalog_manager.cc:1347] Generated new cluster ID: e985c932f9fb4f3fb5bc335286c86197
I20260806 19:28:15.475714 25338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:15.493281 25338 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:15.494683 25338 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:15.501879 25338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9158740b7b447f19db1eb6c7ee682ea: Generated new TSK 0
I20260806 19:28:15.502842 25338 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 19:28:15.541109 25358 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 19:28:15.541249 25358 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 19:28:15.542693 25317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:15.521240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55316 (local address 127.17.18.126:34321)
0806 19:28:15.521558 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:15.521565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:15.521926 (+ 361us) server_negotiation.cc:407] Connection header received
0806 19:28:15.522163 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:15.522169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:15.522271 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:15.522456 (+ 185us) server_negotiation.cc:226] Negotiated authn=JWT
0806 19:28:15.523067 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.524250 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.525866 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.526598 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.526742 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:15.527399 (+ 657us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 19:28:15.541899 (+ 14500us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40301/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 19:28:15.542367 (+ 468us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55316: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40301/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":104}
W20260806 19:28:15.542778 25356 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:15.521004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:34321 (local address 127.0.0.1:55316)
0806 19:28:15.521796 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:15.521818 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:15.521954 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:15.522508 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:15.522513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:15.522525 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0806 19:28:15.522837 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:15.522848 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.524462 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.524467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:15.525702 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:15.525718 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:15.526825 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:15.526830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:15.526986 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:15.527029 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 19:28:15.542204 (+ 15175us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40301/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 19:28:15.542461 (+ 257us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.18.126:34321: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40301/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":465,"threads_started":1}
W20260806 19:28:15.542843 25317 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55316: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40301/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260806 19:28:15.543890 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25216
I20260806 19:28:15.545125 25303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:15.643383 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25216
2026-08-06T19:28:15Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (810 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 19:28:15.708474 17481 mini_oidc.cc:152] Starting JWKS server
I20260806 19:28:15.710510 17481 webserver.cc:460] Webserver started at https://127.0.0.1:34595/ using document root <none> and password file <none>
I20260806 19:28:15.710752 17481 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 19:28:15.711445 17481 webserver.cc:460] Webserver started at http://127.0.0.1:40045/ using document root <none> and password file <none>
2026-08-06T19:28:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:15Z Disabled control of system clock
I20260806 19:28:15.748541 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40597
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:36605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40597
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 19:28:16.108505 25368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:16.108886 25368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:16.109018 25368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:16.117357 25368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:16.117583 25368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:16.117652 25368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:16.117753 25368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:16.117816 25368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 19:28:16.117908 25368 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 19:28:16.117961 25368 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34595/jwks.json
I20260806 19:28:16.128218 25368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:36605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40597
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:16.129791 25368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:16.131808 25368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:16.145195 25381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:16.145157 25378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:16.145274 25377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:16.145980 25368 server_base.cc:1034] running on GCE node
I20260806 19:28:16.147006 25368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:16.148833 25368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:16.150202 25368 hybrid_clock.cc:648] HybridClock initialized: now 1786044496150075 us; error 81 us; skew 500 ppm
I20260806 19:28:16.150767 25368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:16.153735 25368 webserver.cc:460] Webserver started at http://127.17.18.126:43631/ using document root <none> and password file <none>
I20260806 19:28:16.154587 25368 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:16.154721 25368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:16.155093 25368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:16.158591 25368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "f5f097c88ae15608de98486e2a85607a"
server_key_iv: "fdfd4a45e1b604f39a5176d42622307c"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.159581 25368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "f5f097c88ae15608de98486e2a85607a"
server_key_iv: "fdfd4a45e1b604f39a5176d42622307c"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.166014 25368 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:28:16.170203 25391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:16.171931 25368 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:16.172181 25368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "f5f097c88ae15608de98486e2a85607a"
server_key_iv: "fdfd4a45e1b604f39a5176d42622307c"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.172433 25368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:16.196529 25368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:16.197608 25368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:16.197947 25368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:16.218838 25368 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40597
I20260806 19:28:16.218879 25465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40597 every 8 connection(s)
I20260806 19:28:16.220463 25368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:16.224890 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25368
I20260806 19:28:16.224964 25467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:16.225109 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:16.225848 17481 external_mini_cluster.cc:1428] Setting key dfdabde2a0cb7c22f4b2624400af4a50
I20260806 19:28:16.239722 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8: Bootstrap starting.
I20260806 19:28:16.241794 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:16.228071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60858 (local address 127.17.18.126:40597)
0806 19:28:16.229256 (+ 1185us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:16.229272 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:16.229324 (+ 52us) server_negotiation.cc:407] Connection header received
0806 19:28:16.231291 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:16.231324 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:16.231928 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:16.232335 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:16.233095 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.234581 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.236617 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.237543 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.237804 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:16.239059 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:16.239068 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:16.239086 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:16.239717 (+ 631us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:16.239803 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:16.239830 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:16.239946 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:16.240232 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 19:28:16.240585 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":423,"threads_started":1}
I20260806 19:28:16.243481 25467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:16.244683 25467 log.cc:824] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:16.245991 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:28:16.247962 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8: No bootstrap required, opened a new log
I20260806 19:28:16.256243 25467 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } }
I20260806 19:28:16.256712 25467 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:16.256835 25467 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff91ce8af2ba44dfb1c6cc5d13b5cdd8, State: Initialized, Role: FOLLOWER
I20260806 19:28:16.257540 25467 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } }
I20260806 19:28:16.257790 25467 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:16.257905 25467 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:16.258104 25467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:16.260807 25467 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } }
I20260806 19:28:16.261456 25467 leader_election.cc:302] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff91ce8af2ba44dfb1c6cc5d13b5cdd8; no voters:
I20260806 19:28:16.262157 25467 leader_election.cc:288] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:16.262326 25475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:16.263043 25475 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [term 1 LEADER]: Becoming Leader. State: Replica: ff91ce8af2ba44dfb1c6cc5d13b5cdd8, State: Running, Role: LEADER
I20260806 19:28:16.263751 25475 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } }
I20260806 19:28:16.264710 25467 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:16.267190 25476 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } } }
I20260806 19:28:16.267117 25478 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff91ce8af2ba44dfb1c6cc5d13b5cdd8. Latest consensus state: current_term: 1 leader_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff91ce8af2ba44dfb1c6cc5d13b5cdd8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40597 } } }
I20260806 19:28:16.267611 25478 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:16.267611 25476 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:16.269915 25482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:16.277288 25482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:16.289175 25482 catalog_manager.cc:1347] Generated new cluster ID: 30e304b7ea3446ec99cab50e9d3470f4
I20260806 19:28:16.289324 25482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:16.324677 25482 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:16.326792 25482 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:16.334249 25482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff91ce8af2ba44dfb1c6cc5d13b5cdd8: Generated new TSK 0
I20260806 19:28:16.335170 25482 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:28:16.357470 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:16.349203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60868 (local address 127.17.18.126:40597)
0806 19:28:16.349427 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:16.349434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:16.349852 (+ 418us) server_negotiation.cc:407] Connection header received
0806 19:28:16.350110 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:16.350115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:16.350194 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:16.350349 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0806 19:28:16.350863 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.351589 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.353013 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.353582 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.353715 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:16.354305 (+ 590us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 19:28:16.356746 (+ 2441us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 19:28:16.357117 (+ 371us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60868: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 19:28:16.357614 25471 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60868: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 19:28:16.359611 25512 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:16.349049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40597 (local address 127.0.0.1:60868)
0806 19:28:16.349734 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:16.349751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:16.349912 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:16.350390 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:16.350395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:16.350408 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0806 19:28:16.350707 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:16.350717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.351736 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.351741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:16.352857 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:16.352870 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:16.353809 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:16.353815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:16.353960 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:16.353999 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 19:28:16.357019 (+ 3020us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 19:28:16.359126 (+ 2107us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.18.126:40597: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":1711,"thread_start_us":375,"threads_started":1}
I20260806 19:28:16.360917 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25368
I20260806 19:28:16.362483 25457 generic_service.cc:196] Checking for leaks (request via RPC)
E20260806 19:28:16.372680 25514 webserver.cc:533] Webserver: sslize failed:
E20260806 19:28:16.372846 25514 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 19:28:16.462466 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25368
2026-08-06T19:28:16Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (821 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T19:28:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:16Z Disabled control of system clock
I20260806 19:28:16.570422 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42519
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:33845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:42519
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/testchainca.cert with env {}
W20260806 19:28:16.937697 25521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:16.938055 25521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:16.938167 25521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:16.946142 25521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:16.946280 25521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:16.946332 25521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:16.946416 25521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:16.946475 25521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 19:28:16.946563 25521 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 19:28:16.946614 25521 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 19:28:16.957600 25521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:42519
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:16.959070 25521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:16.960466 25521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:16.973532 25527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:16.973448 25531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:16.973536 25533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:16.974555 25521 server_base.cc:1034] running on GCE node
I20260806 19:28:16.975487 25521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:16.977263 25521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:16.978528 25521 hybrid_clock.cc:648] HybridClock initialized: now 1786044496978473 us; error 74 us; skew 500 ppm
I20260806 19:28:16.978919 25521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:16.981542 25521 webserver.cc:460] Webserver started at http://127.17.18.126:40781/ using document root <none> and password file <none>
I20260806 19:28:16.982334 25521 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:16.982437 25521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:16.982729 25521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:16.985996 25521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "3b8075f212b346759197f432c2e813cf"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "c2544e51fbea256c565e5e414ecb8237"
server_key_iv: "3a6c4fa587de9df467a5302b32320ec7"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.986900 25521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "3b8075f212b346759197f432c2e813cf"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "c2544e51fbea256c565e5e414ecb8237"
server_key_iv: "3a6c4fa587de9df467a5302b32320ec7"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.993214 25521 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:28:16.997526 25539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:16.999137 25521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:28:16.999372 25521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "3b8075f212b346759197f432c2e813cf"
format_stamp: "Formatted at 2026-08-06 19:28:16 on dist-test-slave-f0tn"
server_key: "c2544e51fbea256c565e5e414ecb8237"
server_key_iv: "3a6c4fa587de9df467a5302b32320ec7"
server_key_version: "encryptionkey@0"
I20260806 19:28:16.999601 25521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:17.020116 25521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:17.021123 25521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:17.021451 25521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:17.041251 25521 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:42519
I20260806 19:28:17.041282 25628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:42519 every 8 connection(s)
I20260806 19:28:17.042745 25521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:17.046871 25630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:17.048911 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25521
I20260806 19:28:17.049149 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:17.050011 17481 external_mini_cluster.cc:1428] Setting key e87e647bd1c00f467c74746b64e1a81d
I20260806 19:28:17.060475 25630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf: Bootstrap starting.
I20260806 19:28:17.064704 25630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:17.065737 25636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:17.052247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52926 (local address 127.17.18.126:42519)
0806 19:28:17.053451 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:17.053464 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:17.053522 (+ 58us) server_negotiation.cc:407] Connection header received
0806 19:28:17.055278 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:17.055306 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:17.055841 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:17.056229 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:17.056900 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.058396 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.060309 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.061129 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.061288 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:17.062696 (+ 1408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:17.062710 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:17.062727 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:28:17.063548 (+ 821us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:17.063666 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:28:17.063691 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:17.063800 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:17.064139 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 19:28:17.064537 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":405,"threads_started":1}
I20260806 19:28:17.065958 25630 log.cc:824] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:17.069605 25630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf: No bootstrap required, opened a new log
I20260806 19:28:17.070526 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:28:17.078740 25630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } }
I20260806 19:28:17.079150 25630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:17.079249 25630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b8075f212b346759197f432c2e813cf, State: Initialized, Role: FOLLOWER
I20260806 19:28:17.079814 25630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } }
I20260806 19:28:17.080029 25630 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:17.080130 25630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:17.080276 25630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:17.082839 25630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } }
I20260806 19:28:17.083390 25630 leader_election.cc:302] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b8075f212b346759197f432c2e813cf; no voters:
I20260806 19:28:17.084064 25630 leader_election.cc:288] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:17.084242 25638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:17.084956 25638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [term 1 LEADER]: Becoming Leader. State: Replica: 3b8075f212b346759197f432c2e813cf, State: Running, Role: LEADER
I20260806 19:28:17.085660 25638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } }
I20260806 19:28:17.086318 25630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:17.088784 25639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b8075f212b346759197f432c2e813cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } } }
I20260806 19:28:17.089287 25639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:17.088510 25640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b8075f212b346759197f432c2e813cf. Latest consensus state: current_term: 1 leader_uuid: "3b8075f212b346759197f432c2e813cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b8075f212b346759197f432c2e813cf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42519 } } }
I20260806 19:28:17.089843 25640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:17.094216 25653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:17.098901 25653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:17.108948 25653 catalog_manager.cc:1347] Generated new cluster ID: a1f73146a95241c9b7e88334f6c7da9d
I20260806 19:28:17.109095 25653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:17.125874 25653 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:17.127912 25653 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:17.136492 25653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b8075f212b346759197f432c2e813cf: Generated new TSK 0
I20260806 19:28:17.137817 25653 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:28:17.213081 25675 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:17.154894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42519 (local address 127.0.0.1:52942)
0806 19:28:17.155813 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:17.155831 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:17.155984 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:17.156512 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:17.156516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:17.156527 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0806 19:28:17.156837 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:17.156845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.158460 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.158466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:17.159771 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:17.159789 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.161034 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.161040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:17.161306 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:17.161365 (+ 59us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 19:28:17.212399 (+ 51034us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 19:28:17.212752 (+ 353us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.18.126:42519: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":777,"thread_start_us":615,"threads_started":1}
I20260806 19:28:17.213207 25636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:17.155107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.17.18.126:42519)
0806 19:28:17.155363 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:17.155372 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:17.155944 (+ 572us) server_negotiation.cc:407] Connection header received
0806 19:28:17.156189 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:17.156196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:17.156316 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:17.156515 (+ 199us) server_negotiation.cc:226] Negotiated authn=JWT
0806 19:28:17.157004 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.158235 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.159965 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:17.160780 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:17.160953 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:17.161764 (+ 811us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 19:28:17.211883 (+ 50119us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 19:28:17.212586 (+ 703us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52942: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 19:28:17.213452 25636 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52942: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260806 19:28:17.215335 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25521
I20260806 19:28:17.216637 25624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:17.320107 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25521
2026-08-06T19:28:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (836 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (455 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (459 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:18 dist-test-slave-f0tn krb5kdc[25697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:18 dist-test-slave-f0tn krb5kdc[25697](info): set up 2 sockets
Aug 06 19:28:18 dist-test-slave-f0tn krb5kdc[25697](info): commencing operation
krb5kdc: starting...
W20260806 19:28:19.457894 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.001s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:19 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:28:19.729800 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41565
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:41565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:20.109887 25717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:20.110252 25717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:20.110394 25717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:20.118003 25717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:20.118155 25717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:20.118239 25717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:20.118320 25717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:20.118383 25717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:20.128994 25717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:41565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:20.130544 25717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:20.131999 25717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:20.145220 25723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:20.145768 25725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:20.145805 25722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:20.146466 25717 server_base.cc:1034] running on GCE node
I20260806 19:28:20.147342 25717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:20.149045 25717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:20.150290 25717 hybrid_clock.cc:648] HybridClock initialized: now 1786044500150231 us; error 51 us; skew 500 ppm
I20260806 19:28:20.150712 25717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:20 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044500, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:20.154315 25717 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:28:20.156126 25717 webserver.cc:460] Webserver started at http://127.17.18.126:44323/ using document root <none> and password file <none>
I20260806 19:28:20.156912 25717 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:20.157052 25717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:20.157447 25717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:20.160815 25717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "580822bcba5f4bfca6b08fdeea85209a"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "4a3289c195735cf199b1314b38ae3b08"
server_key_iv: "24f5120d21c16bc688fa0417c21d908e"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.161775 25717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "580822bcba5f4bfca6b08fdeea85209a"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "4a3289c195735cf199b1314b38ae3b08"
server_key_iv: "24f5120d21c16bc688fa0417c21d908e"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.168072 25717 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:20.172412 25739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:20.174028 25717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:20.174259 25717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "580822bcba5f4bfca6b08fdeea85209a"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "4a3289c195735cf199b1314b38ae3b08"
server_key_iv: "24f5120d21c16bc688fa0417c21d908e"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.174479 25717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:20.195497 25717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:20.200521 25717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:20.200860 25717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:20.220398 25717 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:41565
I20260806 19:28:20.220455 25817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:41565 every 8 connection(s)
I20260806 19:28:20.221979 25717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:20.226256 25818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:20.229789 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25717
I20260806 19:28:20.230082 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:20.230911 17481 external_mini_cluster.cc:1428] Setting key 6018a3ebbf5976dbb39b1b6112841122
I20260806 19:28:20.240615 25818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a: Bootstrap starting.
I20260806 19:28:20.244316 25818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:20.245791 25818 log.cc:824] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:28:20 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:20.249835 25818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a: No bootstrap required, opened a new log
I20260806 19:28:20.259438 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:20.233354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.17.18.126:41565)
0806 19:28:20.234429 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:20.234443 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:20.234501 (+ 58us) server_negotiation.cc:407] Connection header received
0806 19:28:20.236442 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:20.236477 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:20.236997 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:20.237505 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:20.239322 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.240823 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.242409 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.243244 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.243486 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:20.248801 (+ 5315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:20.248816 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:20.248839 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:20.248908 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:20.253608 (+ 4700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:20.254549 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:20.254563 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:20.254573 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:20.254834 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:20.255336 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:20.255342 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:20.255346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:20.256289 (+ 943us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:20.256664 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:20.257140 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 19:28:20.257741 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":755,"thread_start_us":458,"threads_started":1}
I20260806 19:28:20.261580 25818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } }
I20260806 19:28:20.262161 25818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:20.262300 25818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 580822bcba5f4bfca6b08fdeea85209a, State: Initialized, Role: FOLLOWER
I20260806 19:28:20.263056 25818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } }
I20260806 19:28:20.263415 25818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:20.263602 25818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:20.263763 25818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:20.266340 25818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } }
I20260806 19:28:20.267041 25818 leader_election.cc:302] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 580822bcba5f4bfca6b08fdeea85209a; no voters:
I20260806 19:28:20.267894 25818 leader_election.cc:288] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:20.268014 25824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:20.268872 25824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [term 1 LEADER]: Becoming Leader. State: Replica: 580822bcba5f4bfca6b08fdeea85209a, State: Running, Role: LEADER
I20260806 19:28:20.269550 25824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } }
I20260806 19:28:20.270488 25818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:20.272614 25825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "580822bcba5f4bfca6b08fdeea85209a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } } }
I20260806 19:28:20.273137 25825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:20.275084 25826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 580822bcba5f4bfca6b08fdeea85209a. Latest consensus state: current_term: 1 leader_uuid: "580822bcba5f4bfca6b08fdeea85209a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "580822bcba5f4bfca6b08fdeea85209a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41565 } } }
I20260806 19:28:20.275493 25826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:20.276166 25833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:20.281739 25833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:20.292452 25833 catalog_manager.cc:1347] Generated new cluster ID: 7165375e011c43cda72a3c14f7aefe20
I20260806 19:28:20.292623 25833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:20.305886 25833 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:20.307403 25833 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:20.316818 25833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 580822bcba5f4bfca6b08fdeea85209a: Generated new TSK 0
I20260806 19:28:20.317911 25833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:28:20.387492 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:20.756379 25854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:20.756705 25854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:20.756837 25854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:20.764436 25854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:20.764576 25854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:20.764760 25854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:20.775840 25854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:20.777266 25854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:20.778770 25854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:20.792382 25863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:20.792357 25869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:20.792330 25864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:20.793202 25854 server_base.cc:1034] running on GCE node
I20260806 19:28:20.793864 25854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:20.794857 25854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:20.796120 25854 hybrid_clock.cc:648] HybridClock initialized: now 1786044500796091 us; error 47 us; skew 500 ppm
I20260806 19:28:20.796518 25854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:20 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044500, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:20.799857 25854 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:28:20.801357 25854 webserver.cc:460] Webserver started at http://127.17.18.65:35411/ using document root <none> and password file <none>
I20260806 19:28:20.802119 25854 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:20.802235 25854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:20.802520 25854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:20.805660 25854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "6d806039db87411fa3b2e2ec02ae7ba7"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "b22fa56452ce8babf7c7981b3a37edae"
server_key_iv: "11912e8aabe1ec480ad3c47098c164e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.806455 25854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "6d806039db87411fa3b2e2ec02ae7ba7"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "b22fa56452ce8babf7c7981b3a37edae"
server_key_iv: "11912e8aabe1ec480ad3c47098c164e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.812093 25854 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:28:20.815924 25880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:20.817504 25854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:20.817682 25854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "6d806039db87411fa3b2e2ec02ae7ba7"
format_stamp: "Formatted at 2026-08-06 19:28:20 on dist-test-slave-f0tn"
server_key: "b22fa56452ce8babf7c7981b3a37edae"
server_key_iv: "11912e8aabe1ec480ad3c47098c164e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:20.817878 25854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:20.834929 25854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:20.839627 25854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:20.839916 25854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:20.840935 25854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:20.842485 25854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:20.842566 25854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:20.842667 25854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:20.842716 25854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:20.875605 25854 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:46847
I20260806 19:28:20.875717 26031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:46847 every 8 connection(s)
I20260806 19:28:20.877050 25854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:20.885099 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 25854
I20260806 19:28:20.885363 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:20.886031 17481 external_mini_cluster.cc:1428] Setting key 98058f4e78e4a181ddedb231101dc784
Aug 06 19:28:20 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044500, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:20.898723 26036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:20.879837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:33769 (local address 127.17.18.126:41565)
0806 19:28:20.880385 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:20.880392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:20.881411 (+ 1019us) server_negotiation.cc:407] Connection header received
0806 19:28:20.883313 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:20.883319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:20.883400 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:20.883505 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:20.885275 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.886092 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.888224 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.888633 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.888763 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:20.892582 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:20.892587 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:20.892591 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:20.892628 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:20.895260 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:20.896123 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:20.896128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:20.896131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:20.896276 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:20.896759 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:20.896763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:20.896765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:20.897058 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:20.897214 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:20.898073 (+ 859us) server_negotiation.cc:299] Negotiation successful
0806 19:28:20.898348 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":242,"threads_started":1}
I20260806 19:28:20.899821 26037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:20.880391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41565 (local address 127.17.18.65:33769)
0806 19:28:20.881200 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:20.881246 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:20.883014 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:20.883739 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:20.883747 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:20.884288 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:20.885073 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:20.885104 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.886296 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.886299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:20.888072 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:20.888087 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:20.888892 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:20.888900 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:20.889158 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:20.889862 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:20.889887 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:20.892319 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:20.895439 (+ 3120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:20.895451 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:20.895471 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:20.895985 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:20.896398 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:20.896403 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:20.896407 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:20.896633 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:20.897202 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:20.897212 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:20.897671 (+ 459us) client_negotiation.cc:769] Sending connection context
0806 19:28:20.897940 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 19:28:20.898559 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":316,"threads_started":1}
I20260806 19:28:20.901852 26033 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41565
I20260806 19:28:20.902215 26033 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:20.903047 26033 heartbeater.cc:511] Master 127.17.18.126:41565 requested a full tablet report, sending...
I20260806 19:28:20.905596 25765 ts_manager.cc:194] Registered new tserver with Master: 6d806039db87411fa3b2e2ec02ae7ba7 (127.17.18.65:46847)
I20260806 19:28:20.907392 25765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:33769
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:28:20.945173 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:21.299330 26042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:21.299666 26042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:21.299765 26042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:21.307341 26042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:21.307482 26042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:21.307606 26042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:21.318195 26042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:21.319552 26042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:21.320976 26042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:21.335421 26051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:21.335464 26053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:21.335506 26050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:21.336102 26042 server_base.cc:1034] running on GCE node
I20260806 19:28:21.336788 26042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:21.337924 26042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:21.339151 26042 hybrid_clock.cc:648] HybridClock initialized: now 1786044501339079 us; error 59 us; skew 500 ppm
I20260806 19:28:21.339548 26042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:21 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:21.343118 26042 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:28:21.344825 26042 webserver.cc:460] Webserver started at http://127.17.18.66:39103/ using document root <none> and password file <none>
I20260806 19:28:21.345620 26042 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:21.345744 26042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:21.346071 26042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:21.349267 26042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "7889216dfd294f87adacaf73239b3eef"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "1e6fc8bd60a7b3cb1e26c06a617e6415"
server_key_iv: "bbcf382843b7779fb3a89bb9ee0e3826"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.350205 26042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "7889216dfd294f87adacaf73239b3eef"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "1e6fc8bd60a7b3cb1e26c06a617e6415"
server_key_iv: "bbcf382843b7779fb3a89bb9ee0e3826"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.356366 26042 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:28:21.360383 26060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.362275 26042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:21.362468 26042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "7889216dfd294f87adacaf73239b3eef"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "1e6fc8bd60a7b3cb1e26c06a617e6415"
server_key_iv: "bbcf382843b7779fb3a89bb9ee0e3826"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.362699 26042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:21.386511 26042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:21.391528 26042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:21.391835 26042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:21.392985 26042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:21.394553 26042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:21.394642 26042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.394768 26042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:21.394822 26042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.427225 26042 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:37515
I20260806 19:28:21.427285 26237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:37515 every 8 connection(s)
I20260806 19:28:21.428622 26042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:21.433859 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 26042
I20260806 19:28:21.434108 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:21.434547 17481 external_mini_cluster.cc:1428] Setting key 3445e2974a8d99e1340cea404b544e3f
Aug 06 19:28:21 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:21.453715 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:21.432265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:57375 (local address 127.17.18.126:41565)
0806 19:28:21.435424 (+ 3159us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:21.435430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:21.435451 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:28:21.436670 (+ 1219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:21.436674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:21.436744 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:21.436834 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:21.439119 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:21.439913 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:21.442212 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:21.442708 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:21.442814 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:21.447181 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:21.447188 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:21.447192 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:21.447232 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:21.450071 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:21.451170 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:21.451174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:21.451176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:21.451314 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:21.451803 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:21.451806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:21.451808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:21.452075 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:21.452188 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:21.453176 (+ 988us) server_negotiation.cc:299] Negotiation successful
0806 19:28:21.453403 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3035,"thread_start_us":2919,"threads_started":1}
I20260806 19:28:21.455168 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:21.432709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41565 (local address 127.17.18.66:57375)
0806 19:28:21.433751 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:21.433825 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:21.436329 (+ 2504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:21.437154 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:21.437167 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:21.437987 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:21.438856 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:21.438888 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:21.440096 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:21.440102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:21.442011 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:21.442030 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:21.442953 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:21.442960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:21.443252 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:21.443995 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:21.444024 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:21.446831 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:21.450270 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:21.450282 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:21.450305 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:21.451040 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:21.451419 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:21.451424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:21.451428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:21.451704 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:21.452197 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:21.452205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:21.452744 (+ 539us) client_negotiation.cc:769] Sending connection context
0806 19:28:21.453077 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 19:28:21.453686 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":355,"threads_started":1}
I20260806 19:28:21.456704 26238 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41565
I20260806 19:28:21.457017 26238 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:21.457818 26238 heartbeater.cc:511] Master 127.17.18.126:41565 requested a full tablet report, sending...
I20260806 19:28:21.459331 25765 ts_manager.cc:194] Registered new tserver with Master: 7889216dfd294f87adacaf73239b3eef (127.17.18.66:37515)
I20260806 19:28:21.460150 25765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:57375
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:28:21.496599 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:21.862327 26247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:21.862639 26247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:21.862744 26247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:21.870741 26247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:21.870870 26247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:21.870998 26247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:21.884037 26247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41565
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:21.885427 26247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:21.886879 26247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:21.900637 26255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:21.900607 26259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:21.900730 26256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:21.901327 26247 server_base.cc:1034] running on GCE node
I20260806 19:28:21.902066 26247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:21.903121 26247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:21.904363 26247 hybrid_clock.cc:648] HybridClock initialized: now 1786044501904286 us; error 62 us; skew 500 ppm
I20260806 19:28:21.904739 26247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:21 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:21.908236 26247 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:28:21.909978 26247 webserver.cc:460] Webserver started at http://127.17.18.67:37379/ using document root <none> and password file <none>
I20260806 19:28:21.910732 26247 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:21.910884 26247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:21.911119 26033 heartbeater.cc:503] Master 127.17.18.126:41565 was elected leader, sending a full tablet report...
I20260806 19:28:21.911247 26247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:21.914695 26247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "3fc72687d11f4439a2fc8d63662f9f6e"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "7774d7681287d99312d3d8e08df548b3"
server_key_iv: "cb29a335ea6fb82b261a90f8d1ce00e7"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.915572 26247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "3fc72687d11f4439a2fc8d63662f9f6e"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "7774d7681287d99312d3d8e08df548b3"
server_key_iv: "cb29a335ea6fb82b261a90f8d1ce00e7"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.921239 26247 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:28:21.925112 26268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.926620 26247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:21.926815 26247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "3fc72687d11f4439a2fc8d63662f9f6e"
format_stamp: "Formatted at 2026-08-06 19:28:21 on dist-test-slave-f0tn"
server_key: "7774d7681287d99312d3d8e08df548b3"
server_key_iv: "cb29a335ea6fb82b261a90f8d1ce00e7"
server_key_version: "encryptionkey@0"
I20260806 19:28:21.927029 26247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:21.950240 26247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:21.955107 26247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:21.955399 26247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:21.956573 26247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:21.958086 26247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:21.958175 26247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.958298 26247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:21.958351 26247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:21.991740 26247 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:45663
I20260806 19:28:21.991801 26441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:45663 every 8 connection(s)
I20260806 19:28:21.993083 26247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:21.994683 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 26247
I20260806 19:28:21.994956 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:21.995527 17481 external_mini_cluster.cc:1428] Setting key 5d5efd4238adf3b938f9f2caa7df6299
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044501, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:22.015146 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:21.996109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:45967 (local address 127.17.18.126:41565)
0806 19:28:21.996613 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:21.996619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:21.997814 (+ 1195us) server_negotiation.cc:407] Connection header received
0806 19:28:21.999963 (+ 2149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:21.999967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.000049 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.000152 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.001764 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.002534 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.004185 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.004636 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.004744 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.008449 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.008456 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.008459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.008498 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.011748 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.012599 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.012603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.012625 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.012772 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.013235 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.013239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.013241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.013572 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.013732 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.014496 (+ 764us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.014749 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":228,"threads_started":1}
I20260806 19:28:22.016183 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:21.996686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41565 (local address 127.17.18.67:45967)
0806 19:28:21.997640 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:21.997691 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:21.999694 (+ 2003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:22.000376 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:22.000384 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:22.000913 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:22.001569 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:22.001596 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.002684 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.002689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:22.004016 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:22.004031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.004860 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.004865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:22.005078 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.005800 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:22.005825 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:22.008197 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:22.011914 (+ 3717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:22.011923 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:22.011941 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:22.012460 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:22.012893 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:22.012897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:22.012900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:22.013112 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:22.013708 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:22.013718 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:22.014101 (+ 383us) client_negotiation.cc:769] Sending connection context
0806 19:28:22.014372 (+ 271us) client_negotiation.cc:240] Negotiation successful
0806 19:28:22.014961 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":387,"threads_started":1}
I20260806 19:28:22.017735 26443 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41565
I20260806 19:28:22.018035 26443 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:22.018781 26443 heartbeater.cc:511] Master 127.17.18.126:41565 requested a full tablet report, sending...
I20260806 19:28:22.020390 25765 ts_manager.cc:194] Registered new tserver with Master: 3fc72687d11f4439a2fc8d63662f9f6e (127.17.18.67:45663)
I20260806 19:28:22.021179 25765 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:45967
I20260806 19:28:22.024158 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/test-admin.keytab.
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.057135 17481 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 19:28:22.062929 26458 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:22.060280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36876 (local address 127.17.18.65:46847)
0806 19:28:22.060983 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.060990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.061019 (+ 29us) server_negotiation.cc:407] Connection header received
0806 19:28:22.061092 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.061099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.061316 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.061488 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.062465 (+ 977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36876: BlockingRecv error: recv got EOF from 127.0.0.1:36876 (error 108)
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":380,"threads_started":1}
W20260806 19:28:22.063410 17481 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc)
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.065131 17481 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.066720 17481 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:22.083529 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.068642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.17.18.65:46847)
0806 19:28:22.068882 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.068887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.069042 (+ 155us) server_negotiation.cc:407] Connection header received
0806 19:28:22.069136 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.069141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.069210 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.069300 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.070332 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.071442 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.072802 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.073490 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.073608 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.077586 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.077603 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.077625 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.077669 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.080619 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.081337 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.081345 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.081348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.081555 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.081938 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.081943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.081945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.082391 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.082663 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.082949 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.083213 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260806 19:28:22.090464 26458 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:22.088489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36890 (local address 127.17.18.65:46847)
0806 19:28:22.088748 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.088755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.088969 (+ 214us) server_negotiation.cc:407] Connection header received
0806 19:28:22.089066 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.089069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.089154 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.089246 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.090229 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36890: BlockingRecv error: recv got EOF from 127.0.0.1:36890 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260806 19:28:22.090634 17481 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc' of type FILE
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.092234 17481 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.093734 17481 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:22.109567 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.095266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.17.18.65:46847)
0806 19:28:22.095488 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.095494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.095791 (+ 297us) server_negotiation.cc:407] Connection header received
0806 19:28:22.095860 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.095864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.095936 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.096038 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.097453 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.098213 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.099545 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.100113 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.100255 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.104097 (+ 3842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.104103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.104107 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.104164 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.106858 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.107614 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.107619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.107621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.107760 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.108270 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.108275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.108277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.108595 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.108824 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.109034 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.109217 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 19:28:22.114156 26458 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:22.112427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36908 (local address 127.17.18.65:46847)
0806 19:28:22.112641 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.112647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.112782 (+ 135us) server_negotiation.cc:407] Connection header received
0806 19:28:22.112904 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.112908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.112977 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.113082 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.113903 (+ 821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36908: BlockingRecv error: recv got EOF from 127.0.0.1:36908 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260806 19:28:22.114332 17481 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786044445493736-17481-0/krb5kdc/krb5cc' of type FILE
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.115922 17481 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:22.117413 17481 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:22.133116 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.119233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36914 (local address 127.17.18.65:46847)
0806 19:28:22.119530 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.119536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.119738 (+ 202us) server_negotiation.cc:407] Connection header received
0806 19:28:22.119937 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.119943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.120013 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.120100 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.121143 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.122016 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.123369 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.123790 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.123908 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.127635 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.127640 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.127643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.127684 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.130348 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.131068 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.131073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.131075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.131244 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.131636 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.131640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.131642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.131987 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.132274 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.132555 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.132783 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 19:28:22.134904 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25854
I20260806 19:28:22.147755 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.135603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36928 (local address 127.17.18.65:46847)
0806 19:28:22.135770 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.135776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.136097 (+ 321us) server_negotiation.cc:407] Connection header received
0806 19:28:22.136269 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.136275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.136337 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.136418 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.137473 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.138195 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.139449 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.139906 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.140026 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.142321 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.142326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.142329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.142365 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.144900 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.145749 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.145753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.145756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.145913 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.146365 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.146369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.146371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.146689 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.146896 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.147216 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.147403 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 19:28:22.148448 26027 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:22.238142 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25854
I20260806 19:28:22.261587 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 26042
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:28:22.279815 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.262632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44002 (local address 127.17.18.66:37515)
0806 19:28:22.263287 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.263294 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.263321 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:28:22.263385 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.263391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.263606 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.263739 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.264824 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.266097 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.267555 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.268343 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.268467 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.272790 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.272807 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.272828 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.272886 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.276260 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.277235 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.277245 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.277247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.277442 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.277904 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.277908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.277910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.278406 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.278701 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.279049 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.279441 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":322,"threads_started":1}
I20260806 19:28:22.281208 26232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:22.365155 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 26042
I20260806 19:28:22.385637 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 26247
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[25697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:28:22.403251 26482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:22.386747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56428 (local address 127.17.18.67:45663)
0806 19:28:22.387404 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:22.387411 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:22.387443 (+ 32us) server_negotiation.cc:407] Connection header received
0806 19:28:22.387508 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:22.387517 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:22.387741 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:22.387880 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:22.389030 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.390299 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.391725 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:22.392348 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:22.392466 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:22.396990 (+ 4524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:22.397008 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:22.397028 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:22.397074 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:22.400220 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.401035 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.401044 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.401046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.401190 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:22.401750 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:22.401755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:22.401757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:22.402191 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:22.402466 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:22.402710 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 19:28:22.402954 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":328,"threads_started":1}
I20260806 19:28:22.404703 26435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:22.491067 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 26247
I20260806 19:28:22.512748 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 25717
I20260806 19:28:22.514160 25810 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:22.624287 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 25717
2026-08-06T19:28:22Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4393 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[26487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[26487](info): set up 2 sockets
Aug 06 19:28:22 dist-test-slave-f0tn krb5kdc[26487](info): commencing operation
krb5kdc: starting...
W20260806 19:28:23.835711 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:24 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:24Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab.
Entry for principal oryx/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab.
I20260806 19:28:24.114619 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37961
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab
--principal=oryx/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:24.475865 26504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:24.476172 26504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:24.476305 26504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:24.483814 26504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:24.483945 26504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:24.484002 26504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:24.484086 26504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:24.484143 26504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:24.494942 26504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab
--principal=oryx/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:24.496403 26504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:24.497851 26504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:24.510325 26511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:24.510293 26514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:24.510252 26516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:24.511224 26504 server_base.cc:1034] running on GCE node
I20260806 19:28:24.512290 26504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:24.514045 26504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:24.515276 26504 hybrid_clock.cc:648] HybridClock initialized: now 1786044504515191 us; error 69 us; skew 500 ppm
I20260806 19:28:24.515688 26504 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:24 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:24.519429 26504 init.cc:377] Logged in from keytab as oryx/127.17.18.126@KRBTEST.COM (short username oryx)
I20260806 19:28:24.521047 26504 webserver.cc:460] Webserver started at http://127.17.18.126:39695/ using document root <none> and password file <none>
I20260806 19:28:24.521868 26504 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:24.521996 26504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:24.522269 26504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:24.525581 26504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "b824c1f3834147f2833ca79b591ca786"
format_stamp: "Formatted at 2026-08-06 19:28:24 on dist-test-slave-f0tn"
server_key: "f4283925a879f5efb1be6fe864f9ae87"
server_key_iv: "ecbb954363e81724aa915e15bc43d4eb"
server_key_version: "encryptionkey@0"
I20260806 19:28:24.526468 26504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "b824c1f3834147f2833ca79b591ca786"
format_stamp: "Formatted at 2026-08-06 19:28:24 on dist-test-slave-f0tn"
server_key: "f4283925a879f5efb1be6fe864f9ae87"
server_key_iv: "ecbb954363e81724aa915e15bc43d4eb"
server_key_version: "encryptionkey@0"
I20260806 19:28:24.532222 26504 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:28:24.536072 26527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:24.537708 26504 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:24.537889 26504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "b824c1f3834147f2833ca79b591ca786"
format_stamp: "Formatted at 2026-08-06 19:28:24 on dist-test-slave-f0tn"
server_key: "f4283925a879f5efb1be6fe864f9ae87"
server_key_iv: "ecbb954363e81724aa915e15bc43d4eb"
server_key_version: "encryptionkey@0"
I20260806 19:28:24.538093 26504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:24.557176 26504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:24.562206 26504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:24.562475 26504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:24.581410 26504 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:37961
I20260806 19:28:24.581442 26597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:37961 every 8 connection(s)
I20260806 19:28:24.582954 26504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:24.586944 26598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:24.593084 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 26504
I20260806 19:28:24.593312 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:24.593987 17481 external_mini_cluster.cc:1428] Setting key de02130f8253dfc59b9445c24ed384ad
I20260806 19:28:24.598915 26598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Bootstrap starting.
I20260806 19:28:24.602954 26598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:24.604290 26598 log.cc:824] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:24.607475 26598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: No bootstrap required, opened a new log
Aug 06 19:28:24 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:24.615693 26598 raft_consensus.cc:348] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } }
I20260806 19:28:24.616096 26598 raft_consensus.cc:374] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:24.616226 26598 raft_consensus.cc:729] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b824c1f3834147f2833ca79b591ca786, State: Initialized, Role: FOLLOWER
I20260806 19:28:24.617019 26598 consensus_queue.cc:260] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } }
I20260806 19:28:24.617324 26598 raft_consensus.cc:388] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:24.617502 26598 raft_consensus.cc:482] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:24.617695 26598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:24.618571 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:24.596241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.17.18.126:37961)
0806 19:28:24.597148 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:24.597162 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:24.597209 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:28:24.599030 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:24.599059 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:24.599503 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:24.599864 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:24.601902 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:24.603382 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:24.605206 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:24.606019 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:24.606216 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:24.610412 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:24.610421 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:24.610443 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:24.610495 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:24.613941 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:24.614738 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:24.614747 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:24.614755 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:24.614952 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:24.615349 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:24.615353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:24.615355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:24.615982 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:24.616298 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:24.616907 (+ 609us) server_negotiation.cc:299] Negotiation successful
0806 19:28:24.617354 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":420,"threads_started":1}
I20260806 19:28:24.620334 26598 raft_consensus.cc:504] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } }
I20260806 19:28:24.621024 26598 leader_election.cc:302] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b824c1f3834147f2833ca79b591ca786; no voters:
I20260806 19:28:24.621812 26598 leader_election.cc:288] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:24.621958 26604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:24.622736 26604 raft_consensus.cc:686] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: Becoming Leader. State: Replica: b824c1f3834147f2833ca79b591ca786, State: Running, Role: LEADER
I20260806 19:28:24.623281 26604 consensus_queue.cc:237] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } }
I20260806 19:28:24.624140 26598 sys_catalog.cc:564] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:24.626183 26606 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } }
I20260806 19:28:24.626397 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b824c1f3834147f2833ca79b591ca786. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } }
I20260806 19:28:24.626628 26606 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:24.626713 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:24.627656 26612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:24.634262 26612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:24.644752 26612 catalog_manager.cc:1347] Generated new cluster ID: 5dbfebd39ad64c6c97e91694e0f16bfd
I20260806 19:28:24.644919 26612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:24.667140 26612 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:24.669256 26612 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:24.689334 26612 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Generated new TSK 0
I20260806 19:28:24.690373 26612 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
I20260806 19:28:24.771706 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:25.168497 26642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:25.168828 26642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:25.168943 26642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:25.176505 26642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:25.176642 26642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:25.176800 26642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:25.187080 26642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:25.188575 26642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:25.190186 26642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:25.204352 26649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:25.204386 26652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:25.204403 26650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:25.205427 26642 server_base.cc:1034] running on GCE node
I20260806 19:28:25.206171 26642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:25.207266 26642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:25.208484 26642 hybrid_clock.cc:648] HybridClock initialized: now 1786044505208417 us; error 63 us; skew 500 ppm
I20260806 19:28:25.208832 26642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:25 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044505, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:25.216385 26642 init.cc:377] Logged in from keytab as oryx/127.17.18.65@KRBTEST.COM (short username oryx)
I20260806 19:28:25.218181 26642 webserver.cc:460] Webserver started at http://127.17.18.65:37539/ using document root <none> and password file <none>
I20260806 19:28:25.218966 26642 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:25.219076 26642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:25.219348 26642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:25.222642 26642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "5459b6162100402e97bbecb5497470bc"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "4883079358051121d264203eb5080562"
server_key_iv: "3db47592d79cf454f32bd3d4c63bb31d"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.223510 26642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "5459b6162100402e97bbecb5497470bc"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "4883079358051121d264203eb5080562"
server_key_iv: "3db47592d79cf454f32bd3d4c63bb31d"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.229844 26642 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 19:28:25.233985 26664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.235582 26642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:28:25.235769 26642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5459b6162100402e97bbecb5497470bc"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "4883079358051121d264203eb5080562"
server_key_iv: "3db47592d79cf454f32bd3d4c63bb31d"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.235977 26642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:25.251175 26642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:25.255635 26642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:25.255936 26642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:25.257009 26642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:25.258596 26642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:25.258680 26642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.258792 26642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:25.258853 26642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.290861 26642 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:36143
I20260806 19:28:25.290901 26823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:36143 every 8 connection(s)
I20260806 19:28:25.292168 26642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:25.295734 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 26642
I20260806 19:28:25.296023 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:25.296808 17481 external_mini_cluster.cc:1428] Setting key 62a92db9722f3b0bf84e0a149f222f48
Aug 06 19:28:25 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044505, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:25.315392 26826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:25.294867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43113 (local address 127.17.18.126:37961)
0806 19:28:25.295328 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:25.295332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:25.296428 (+ 1096us) server_negotiation.cc:407] Connection header received
0806 19:28:25.298505 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:25.298511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:25.298599 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:25.298724 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:25.301167 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.302003 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.304311 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.304735 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.304847 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:25.309166 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:25.309172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:25.309175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:25.309230 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:25.311921 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:25.312781 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:25.312786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:25.312788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:25.312925 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:25.313436 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:25.313441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:25.313443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:25.313769 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:25.313916 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:25.314740 (+ 824us) server_negotiation.cc:299] Negotiation successful
0806 19:28:25.315005 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":226,"threads_started":1}
I20260806 19:28:25.316676 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:25.295351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:43113)
0806 19:28:25.296248 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:25.296299 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:25.298153 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:25.299151 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:25.299165 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:25.300004 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:25.300917 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:25.300945 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.302195 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.302201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:25.304079 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:25.304097 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.305002 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.305010 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:25.305318 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:25.306238 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:25.306264 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:25.308859 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:25.312126 (+ 3267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:25.312134 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:25.312152 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:25.312641 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:25.313047 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:25.313052 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:25.313057 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:25.313291 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:25.313909 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:25.313919 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:25.314328 (+ 409us) client_negotiation.cc:769] Sending connection context
0806 19:28:25.314603 (+ 275us) client_negotiation.cc:240] Negotiation successful
0806 19:28:25.315236 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":335,"threads_started":1}
I20260806 19:28:25.318503 26824 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:25.318913 26824 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:25.319977 26824 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:25.322872 26551 ts_manager.cc:194] Registered new tserver with Master: 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
WARNING: no policy specified for oryx/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:28:25.324491 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:43113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
I20260806 19:28:25.359028 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:25.716289 26832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:25.716631 26832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:25.716779 26832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:25.724341 26832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:25.724491 26832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:25.724691 26832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:25.735163 26832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:25.736639 26832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:25.738111 26832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:25.752031 26840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:25.752054 26841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:25.752167 26845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:25.752861 26832 server_base.cc:1034] running on GCE node
I20260806 19:28:25.753640 26832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:25.754725 26832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:25.755939 26832 hybrid_clock.cc:648] HybridClock initialized: now 1786044505755870 us; error 64 us; skew 500 ppm
I20260806 19:28:25.756281 26832 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:25 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044505, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:25.759536 26832 init.cc:377] Logged in from keytab as oryx/127.17.18.66@KRBTEST.COM (short username oryx)
I20260806 19:28:25.761165 26832 webserver.cc:460] Webserver started at http://127.17.18.66:45313/ using document root <none> and password file <none>
I20260806 19:28:25.762005 26832 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:25.762143 26832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:25.762455 26832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:25.765596 26832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "2875509ec9d646808d2b9ff6aca12c3e"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "94851284b68ae6580f54c5f9b73268d9"
server_key_iv: "d4c8f971905f6128c2a7150ed23deaf1"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.766414 26832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "2875509ec9d646808d2b9ff6aca12c3e"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "94851284b68ae6580f54c5f9b73268d9"
server_key_iv: "d4c8f971905f6128c2a7150ed23deaf1"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.771791 26832 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 19:28:25.775703 26855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.777314 26832 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:28:25.777556 26832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "2875509ec9d646808d2b9ff6aca12c3e"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "94851284b68ae6580f54c5f9b73268d9"
server_key_iv: "d4c8f971905f6128c2a7150ed23deaf1"
server_key_version: "encryptionkey@0"
I20260806 19:28:25.777782 26832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:25.790863 26832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:25.795547 26832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:25.795858 26832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:25.796936 26832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:25.798475 26832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:25.798560 26832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.798688 26832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:25.798743 26832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:25.831034 26832 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45657
I20260806 19:28:25.831092 27016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45657 every 8 connection(s)
I20260806 19:28:25.832355 26832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:25.836760 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 26832
I20260806 19:28:25.836946 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:25.837399 17481 external_mini_cluster.cc:1428] Setting key beaf38ae9ca0cc72257eefd39d1842f3
Aug 06 19:28:25 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044505, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:25.854261 27020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:25.834993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:56503 (local address 127.17.18.126:37961)
0806 19:28:25.835416 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:25.835421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:25.836444 (+ 1023us) server_negotiation.cc:407] Connection header received
0806 19:28:25.838515 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:25.838519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:25.838588 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:25.838691 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:25.840664 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.841514 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.843387 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.843822 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.843943 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:25.847663 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:25.847668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:25.847672 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:25.847710 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:25.850765 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:25.851642 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:25.851648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:25.851651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:25.851813 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:25.852230 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:25.852235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:25.852237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:25.852594 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:25.852768 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:25.853634 (+ 866us) server_negotiation.cc:299] Negotiation successful
0806 19:28:25.853876 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":197,"threads_started":1}
I20260806 19:28:25.855171 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:25.835540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:56503)
0806 19:28:25.836278 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:25.836318 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:25.838256 (+ 1938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:25.838980 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:25.838992 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:25.839763 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:25.840488 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:25.840510 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.841665 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.841669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:25.843223 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:25.843243 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:25.844065 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:25.844073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:25.844313 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:25.845045 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:25.845071 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:25.847390 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:25.850959 (+ 3569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:25.850969 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:25.850986 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:25.851500 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:25.851913 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:25.851916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:25.851918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:25.852123 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:25.852767 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:25.852774 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:25.853153 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 19:28:25.853523 (+ 370us) client_negotiation.cc:240] Negotiation successful
0806 19:28:25.853987 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":283,"threads_started":1}
I20260806 19:28:25.856729 27018 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:25.857105 27018 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:25.858145 27018 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:25.859998 26551 ts_manager.cc:194] Registered new tserver with Master: 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:25.860852 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:56503
WARNING: no policy specified for oryx/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
I20260806 19:28:25.899286 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:26.251765 27026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:26.252091 27026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:26.252226 27026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:26.259788 27026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:26.259922 27026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:26.260075 27026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:26.270550 27026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:37961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:26.272248 27026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:26.273818 27026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:26.287308 27033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:26.287348 27038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:26.287376 27034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:26.288460 27026 server_base.cc:1034] running on GCE node
I20260806 19:28:26.289103 27026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:26.290196 27026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:26.291455 27026 hybrid_clock.cc:648] HybridClock initialized: now 1786044506291339 us; error 103 us; skew 500 ppm
I20260806 19:28:26.291836 27026 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044506, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:26.295715 27026 init.cc:377] Logged in from keytab as oryx/127.17.18.67@KRBTEST.COM (short username oryx)
I20260806 19:28:26.297369 27026 webserver.cc:460] Webserver started at http://127.17.18.67:39821/ using document root <none> and password file <none>
I20260806 19:28:26.298121 27026 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:26.298243 27026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:26.298555 27026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:26.301600 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "c00f151cd42040c38c43f5dbeffaa504"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "a57ace2a7d667045e05bfb3e09796c36"
server_key_iv: "49014a212518aeccc439e440c86fd050"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.302461 27026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "c00f151cd42040c38c43f5dbeffaa504"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "a57ace2a7d667045e05bfb3e09796c36"
server_key_iv: "49014a212518aeccc439e440c86fd050"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.308029 27026 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:28:26.311861 27049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:26.313334 27026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:28:26.313540 27026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "c00f151cd42040c38c43f5dbeffaa504"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "a57ace2a7d667045e05bfb3e09796c36"
server_key_iv: "49014a212518aeccc439e440c86fd050"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.313741 27026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:26.326314 27026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:26.328212 26824 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
I20260806 19:28:26.331210 27026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:26.331496 27026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:26.332552 27026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:26.334017 27026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:26.334097 27026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:26.334221 27026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:26.334276 27026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:26.365834 27026 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:33689
I20260806 19:28:26.365891 27208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:33689 every 8 connection(s)
I20260806 19:28:26.367187 27026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:26.377116 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 27026
I20260806 19:28:26.377368 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:26.377957 17481 external_mini_cluster.cc:1428] Setting key 8f50e400574c5a6fca71d1142353461c
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044506, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:26.389542 27214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.369985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:42545 (local address 127.17.18.126:37961)
0806 19:28:26.370517 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:26.370522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:26.371442 (+ 920us) server_negotiation.cc:407] Connection header received
0806 19:28:26.373429 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:26.373436 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:26.373547 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:26.373652 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:26.375676 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.376577 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.379109 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.379731 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.379842 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.383981 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:26.383987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:26.383991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:26.384029 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:26.386556 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.387335 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.387339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.387341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.387460 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.387856 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.387860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.387862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.388163 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:26.388283 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:26.388996 (+ 713us) server_negotiation.cc:299] Negotiation successful
0806 19:28:26.389197 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":256,"threads_started":1}
I20260806 19:28:26.390578 27215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.370418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:42545)
0806 19:28:26.371242 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:26.371295 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:26.373041 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:26.374107 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:26.374118 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:26.374744 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:26.375398 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.375419 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.376833 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.376840 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.378906 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.378936 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.380006 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.380014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.380319 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.381068 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:26.381102 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:26.383737 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:26.386724 (+ 2987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:26.386733 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:26.386751 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:26.387231 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:26.387537 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:26.387540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:26.387542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:26.387762 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:26.388260 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:26.388267 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:26.388633 (+ 366us) client_negotiation.cc:769] Sending connection context
0806 19:28:26.388906 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 19:28:26.389351 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":332,"threads_started":1}
I20260806 19:28:26.392285 27209 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:26.392704 27209 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:26.393703 27209 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:26.395496 26551 ts_manager.cc:194] Registered new tserver with Master: c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689)
I20260806 19:28:26.396371 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:42545
I20260806 19:28:26.407459 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.18.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.125.keytab.
Entry for principal oryx/127.17.18.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.125.keytab.
I20260806 19:28:26.469321 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:42045
--webserver_interface=127.17.18.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.125.keytab
--principal=oryx/127.17.18.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37961,127.17.18.125:42045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:26.833698 27218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:26.834133 27218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:26.834300 27218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:26.843175 27218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:26.843307 27218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:26.843362 27218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:26.843421 27218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:26.843464 27218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:26.853986 27218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37961,127.17.18.125:42045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.125.keytab
--principal=oryx/127.17.18.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:42045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.18.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
W20260806 19:28:26.854389 27218 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.18.126:37961,127.17.18.125:42045'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 19:28:26.855496 27218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:26.856845 27218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 19:28:26.864442 27018 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
W20260806 19:28:26.869987 27225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:26.869900 27230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:26.869952 27226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:26.870744 27218 server_base.cc:1034] running on GCE node
I20260806 19:28:26.871546 27218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:26.873066 27218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:26.874289 27218 hybrid_clock.cc:648] HybridClock initialized: now 1786044506874209 us; error 60 us; skew 500 ppm
I20260806 19:28:26.874639 27218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044506, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:26.877942 27218 init.cc:377] Logged in from keytab as oryx/127.17.18.125@KRBTEST.COM (short username oryx)
I20260806 19:28:26.879531 27218 webserver.cc:460] Webserver started at http://127.17.18.125:45715/ using document root <none> and password file <none>
I20260806 19:28:26.880298 27218 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:26.880411 27218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:26.880748 27218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:26.884063 27218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/instance:
uuid: "88db63cf13d045afa40beb78869712aa"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "c3dc799e067fe93fd49578fb3d262a81"
server_key_iv: "e24db9161986148d95391da6211ac04b"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.884904 27218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal/instance:
uuid: "88db63cf13d045afa40beb78869712aa"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "c3dc799e067fe93fd49578fb3d262a81"
server_key_iv: "e24db9161986148d95391da6211ac04b"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.890594 27218 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 19:28:26.894369 27244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:26.896006 27218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:28:26.896260 27218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "88db63cf13d045afa40beb78869712aa"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "c3dc799e067fe93fd49578fb3d262a81"
server_key_iv: "e24db9161986148d95391da6211ac04b"
server_key_version: "encryptionkey@0"
I20260806 19:28:26.896493 27218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:26.929703 27218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:26.934871 27218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:26.935178 27218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:26.954725 27218 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.125:42045
I20260806 19:28:26.954744 27323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.125:42045 every 8 connection(s)
I20260806 19:28:26.956166 27218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
I20260806 19:28:26.959523 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 27218
I20260806 19:28:26.960645 27326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:26.970772 27326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044506, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.125@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:26.987641 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.962399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.17.18.125:42045)
0806 19:28:26.963338 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:26.963351 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:26.963398 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:28:26.966225 (+ 2827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:26.966261 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:26.966779 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:26.967356 (+ 577us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:26.969004 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.970452 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.971812 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.972873 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.973069 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.978418 (+ 5349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:26.978427 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:26.978441 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:26.978487 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:26.982423 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.983346 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.983356 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.983367 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.983579 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.984011 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.984016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.984020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.984652 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:26.984959 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:26.985522 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 19:28:26.986036 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":437,"threads_started":1}
I20260806 19:28:26.990078 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.973873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41696)
0806 19:28:26.974652 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:26.974696 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:26.974868 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:26.975335 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:26.975341 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:26.976048 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:26.976336 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.976345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.977504 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.977510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.978935 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.978953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.979855 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.979866 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.980075 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.980597 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:26.980622 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:26.983441 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:26.987090 (+ 3649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:26.987101 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:26.987110 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:26.987745 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:26.988219 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:26.988224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:26.988228 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:26.988427 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:26.989050 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:26.989058 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:26.989249 (+ 191us) client_negotiation.cc:769] Sending connection context
0806 19:28:26.989479 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 19:28:26.989772 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":333,"threads_started":1}
I20260806 19:28:26.990242 27332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.973930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41696 (local address 127.17.18.126:37961)
0806 19:28:26.974404 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:26.974410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:26.974805 (+ 395us) server_negotiation.cc:407] Connection header received
0806 19:28:26.975000 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:26.975006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:26.975112 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:26.975235 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:26.976516 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.977331 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.979107 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.979647 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.979755 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.983676 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:26.983681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:26.983685 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:26.983735 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:26.986845 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.987916 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.987922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.987925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.988095 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:26.988548 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:26.988551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:26.988553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:26.988919 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:26.989051 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:26.989649 (+ 598us) server_negotiation.cc:299] Negotiation successful
0806 19:28:26.989905 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":229,"threads_started":1}
I20260806 19:28:26.992220 27326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:28:26 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044506, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.125@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
I20260806 19:28:27.005439 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.993097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46332)
0806 19:28:26.993451 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:26.993472 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:26.993596 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:26.993884 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:26.993889 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:26.994306 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:26.994457 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.994465 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.995484 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.995489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.996344 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:26.996357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.997033 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.997039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:26.997210 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:26.997783 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:26.997799 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.000058 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.003192 (+ 3134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.003197 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.003200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.003592 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.003959 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.003962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.003965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.004092 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.004674 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.004677 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.004817 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.004926 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.005158 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158}
I20260806 19:28:27.005683 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:26.993110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.17.18.125:42045)
0806 19:28:26.993551 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:26.993557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:26.993576 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:28:26.993708 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:26.993713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:26.993773 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:26.993852 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:26.994592 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.995342 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.996479 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:26.996882 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:26.996994 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.000307 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.000313 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.000316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.000350 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.003053 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.003728 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.003733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.003735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.003867 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.004209 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.004213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.004215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.004562 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.004679 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.005014 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.005300 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":342}
I20260806 19:28:27.010653 27326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Bootstrap starting.
I20260806 19:28:27.013993 27326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:27.015123 27326 log.cc:824] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:27.018299 27326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: No bootstrap required, opened a new log
I20260806 19:28:27.025915 27326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } }
I20260806 19:28:27.026331 27326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:27.026454 27326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88db63cf13d045afa40beb78869712aa, State: Initialized, Role: FOLLOWER
I20260806 19:28:27.027132 27326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } }
I20260806 19:28:27.028164 27334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } }
I20260806 19:28:27.028487 27334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:27.029273 27326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:28:27.038551 27350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:28:27.038707 27350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:28:27.043592 27218 master_runner.cc:428] Detected that this master 88db63cf13d045afa40beb78869712aa is joining an existing cluster
I20260806 19:28:27.043732 27218 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.18.125:42045
I20260806 19:28:27.075610 27332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.049555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.17.18.126:37961)
0806 19:28:27.049777 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.049785 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.056372 (+ 6587us) server_negotiation.cc:407] Connection header received
0806 19:28:27.057102 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.057110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.057223 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.057306 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.059012 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.060387 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.062700 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.063419 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.063535 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.066752 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.066760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.066766 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.066814 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.071540 (+ 4726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.072563 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.072827 (+ 264us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.072834 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.073033 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.073647 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.073653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.073656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.074077 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.074243 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.074935 (+ 692us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.075238 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:28:27.077126 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.048956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41704)
0806 19:28:27.056199 (+ 7243us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.056228 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.056890 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.057620 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.057625 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.058352 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.058804 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.058819 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.060629 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.060636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.062482 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.062502 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.063886 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.063894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.064129 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.065122 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.065159 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.066497 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.071734 (+ 5237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.071740 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.071744 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.072386 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.073224 (+ 838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.073229 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.073233 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.073478 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.074343 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.074348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.074568 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.076237 (+ 1669us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.076632 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7035,"thread_start_us":12294,"threads_started":1}
I20260806 19:28:27.078203 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.048885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46340 (local address 127.17.18.125:42045)
0806 19:28:27.049107 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.049113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.061785 (+ 12672us) server_negotiation.cc:407] Connection header received
0806 19:28:27.061999 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.062003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.062074 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.062133 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.064256 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.065296 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.067262 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.067916 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.068007 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.070505 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.070511 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.070518 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.070551 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.074460 (+ 3909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.075355 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.075361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.075364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.075576 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.076048 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.076053 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.076057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.076484 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.076647 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.077259 (+ 612us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.077537 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:28:27.080193 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.049329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46340)
0806 19:28:27.061665 (+ 12336us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.061687 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.061890 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.062327 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.062330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.063768 (+ 1438us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.064098 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.064107 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.065539 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.065544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.067083 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.067098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.068309 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.068315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.068469 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.069103 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.069123 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.070305 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.074653 (+ 4348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.074658 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.074662 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.075192 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.075734 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.075738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.075742 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.075916 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.076748 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.076752 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.076936 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.077995 (+ 1059us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.079676 (+ 1681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12178,"mutex_wait_us":3,"thread_start_us":7071,"threads_started":1}
WARNING: no policy specified for oryx/127.17.18.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.124@KRBTEST.COM" created.
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.126@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
I20260806 19:28:27.106961 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.086391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.17.18.125:42045)
0806 19:28:27.086629 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.086640 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.087193 (+ 553us) server_negotiation.cc:407] Connection header received
0806 19:28:27.087612 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.087616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.087731 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.087829 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.089626 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.090862 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.093013 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.093763 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.093917 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.098878 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.098886 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.098892 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.098944 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.102973 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.104217 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.104225 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.104229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.104419 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.104940 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.104945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.104947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.105351 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.105626 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.106238 (+ 612us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.106521 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 19:28:27.107033 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.086120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46350)
0806 19:28:27.087009 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.087070 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.087306 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.087926 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.087934 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.088948 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.089311 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.089329 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.091068 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.091074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.092785 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.092805 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.093992 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.093999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.094252 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.095137 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.095163 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.098606 (+ 3443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.103243 (+ 4637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.103269 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.103280 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.104035 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.104568 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.104575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.104578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.104792 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.105627 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.105638 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.105860 (+ 222us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.106090 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.106504 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":299,"threads_started":1}
I20260806 19:28:27.109556 26551 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.18.125:42045: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "88db63cf13d045afa40beb78869712aa"
member_type: NON_VOTER
last_known_addr {
host: "127.17.18.125"
port: 42045
}
attrs {
promote: true
}
}
dest_uuid: "b824c1f3834147f2833ca79b591ca786"
cas_config_opid_index: -1
I20260806 19:28:27.111227 26551 consensus_queue.cc:237] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } }
I20260806 19:28:27.125643 27372 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 88db63cf13d045afa40beb78869712aa (127.17.18.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:27.127199 27289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:27.131031 27289 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 19:28:27.131309 27372 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.18.125:42045
I20260806 19:28:27.132804 27375 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:27.133855 27218 master.cc:537] Master@127.17.18.125:42045 shutting down...
I20260806 19:28:27.133643 27373 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:27.134037 27373 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.124.keytab.
Entry for principal oryx/127.17.18.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.124.keytab.
W20260806 19:28:27.137770 26533 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260806 19:28:27.137975 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:36899
--webserver_interface=127.17.18.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.124.keytab
--principal=oryx/127.17.18.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:27.139752 26533 consensus_peers.cc:487] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 -> Peer 88db63cf13d045afa40beb78869712aa (127.17.18.125:42045): Couldn't send request to peer 88db63cf13d045afa40beb78869712aa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 19:28:27.151247 27218 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:27.151813 27218 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:27.152081 27218 tablet_replica.cc:330] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: stopping tablet replica
I20260806 19:28:27.159788 27218 master.cc:552] Master@127.17.18.125:42045 shutdown complete.
I20260806 19:28:27.159952 27218 master_runner.cc:305] Clearing existing system tablet
I20260806 19:28:27.160414 27218 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:27.160531 27218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:27.163841 27218 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 19:28:27.165789 27382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:27.166181 27218 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:27.166469 27218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:27.166584 27218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "88db63cf13d045afa40beb78869712aa"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "c3dc799e067fe93fd49578fb3d262a81"
server_key_iv: "e24db9161986148d95391da6211ac04b"
server_key_version: "encryptionkey@0"
I20260806 19:28:27.172492 27218 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:27.180398 27218 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 19:28:27.180644 27218 log.cc:1196] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 19:28:27.181257 27218 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Deleting consensus metadata
I20260806 19:28:27.181645 27218 master_runner.cc:315] Copying system tablet from 127.17.18.126:37961
I20260806 19:28:27.187541 27218 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: tablet copy: Beginning tablet copy session from remote peer at address 127.17.18.126:37961
I20260806 19:28:27.209242 27332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.188865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41720 (local address 127.17.18.126:37961)
0806 19:28:27.189070 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.189077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.192911 (+ 3834us) server_negotiation.cc:407] Connection header received
0806 19:28:27.193094 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.193100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.193252 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.193419 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.194816 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.195954 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.197938 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.198578 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.198735 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.201291 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.201298 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.201304 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.201353 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.205688 (+ 4335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.206793 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.206800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.206805 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.206991 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.207493 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.207498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.207502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.207925 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.208104 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.208597 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.208846 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:28:27.209290 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.188724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41720)
0806 19:28:27.192712 (+ 3988us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.192743 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.192949 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.193478 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.193483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.194254 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.194571 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.194593 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.196172 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.196178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.197741 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.197762 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.198785 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.198792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.198986 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.199787 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.199811 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.200971 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.205951 (+ 4980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.205964 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.205969 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.206585 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.207139 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.207144 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.207147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.207356 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.208076 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.208081 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.208289 (+ 208us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.208450 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.208819 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3820,"thread_start_us":3692,"threads_started":1}
I20260806 19:28:27.210834 26576 tablet_copy_service.cc:140] P b824c1f3834147f2833ca79b591ca786: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 88db63cf13d045afa40beb78869712aa ({username='oryx', principal='oryx/127.17.18.125@KRBTEST.COM'} at 127.0.0.1:41720)
I20260806 19:28:27.211334 26576 tablet_copy_service.cc:161] P b824c1f3834147f2833ca79b591ca786: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 88db63cf13d045afa40beb78869712aa at {username='oryx', principal='oryx/127.17.18.125@KRBTEST.COM'} at 127.0.0.1:41720: session id = 88db63cf13d045afa40beb78869712aa-00000000000000000000000000000000
I20260806 19:28:27.216732 26576 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 19:28:27.220273 27218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 19:28:27.228487 27218 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: tablet copy: Starting download of 0 data blocks...
I20260806 19:28:27.228962 27218 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: tablet copy: Starting download of 1 WAL segments...
I20260806 19:28:27.233922 27218 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 19:28:27.239473 26576 tablet_copy_service.cc:342] P b824c1f3834147f2833ca79b591ca786: Request end of tablet copy session 88db63cf13d045afa40beb78869712aa-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.18.125@KRBTEST.COM'} at 127.0.0.1:41720
I20260806 19:28:27.239837 26576 tablet_copy_service.cc:433] P b824c1f3834147f2833ca79b591ca786: ending tablet copy session 88db63cf13d045afa40beb78869712aa-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 88db63cf13d045afa40beb78869712aa
I20260806 19:28:27.255276 27218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:27.258385 27392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:27.258495 27393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:27.263968 27397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:27.264392 27218 server_base.cc:1034] running on GCE node
I20260806 19:28:27.264777 27218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:27.265509 27218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:27.266753 27218 hybrid_clock.cc:648] HybridClock initialized: now 1786044507266673 us; error 44 us; skew 500 ppm
I20260806 19:28:27.267009 27218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044507, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:27.269646 27218 init.cc:377] Logged in from keytab as oryx/127.17.18.125@KRBTEST.COM (short username oryx)
I20260806 19:28:27.274649 27218 webserver.cc:460] Webserver started at http://127.17.18.125:44793/ using document root <none> and password file <none>
I20260806 19:28:27.275068 27218 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:27.275154 27218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:27.278506 27218 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 19:28:27.280649 27407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:27.281224 27218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 19:28:27.281414 27218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "88db63cf13d045afa40beb78869712aa"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "c3dc799e067fe93fd49578fb3d262a81"
server_key_iv: "e24db9161986148d95391da6211ac04b"
server_key_version: "encryptionkey@0"
I20260806 19:28:27.281607 27218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:27.309288 27218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:27.313555 27218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:27.350878 27218 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.125:42045
I20260806 19:28:27.350939 27481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.125:42045 every 8 connection(s)
I20260806 19:28:27.352046 27218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
I20260806 19:28:27.357901 27484 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:28:27.362234 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Bootstrap starting.
I20260806 19:28:27.384044 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:28:27.384640 27484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: Bootstrap complete.
I20260806 19:28:27.385710 27484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } }
I20260806 19:28:27.385942 27484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 88db63cf13d045afa40beb78869712aa, State: Initialized, Role: LEARNER
I20260806 19:28:27.386189 27484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } }
I20260806 19:28:27.387045 27488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:27.387416 27484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:27.387574 27488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: LEARNER
I20260806 19:28:27.396135 27502 catalog_manager.cc:1259] Loaded cluster ID: 5dbfebd39ad64c6c97e91694e0f16bfd
I20260806 19:28:27.396409 27502 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: loading cluster ID for follower catalog manager: success
I20260806 19:28:27.399259 27502 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: acquiring CA information for follower catalog manager: success
I20260806 19:28:27.399346 27209 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
I20260806 19:28:27.402217 27502 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 19:28:27.729285 27379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:27.729729 27379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:27.729861 27379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:27.744608 27379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:27.744879 27379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:27.745070 27379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:27.745289 27379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:27.745482 27379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:27.767170 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.748307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46354)
0806 19:28:27.755443 (+ 7136us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.755462 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.755626 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.756109 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.756113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.756139 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:27.756507 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.756520 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.759438 (+ 2918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.759443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.761280 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.761300 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.766214 (+ 4914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.766222 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.766429 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.766493 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.766599 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.766729 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6978,"thread_start_us":6821,"threads_started":1}
I20260806 19:28:27.767115 27379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.124.keytab
--principal=oryx/127.17.18.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:36899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.18.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:27.767565 27510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.748936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46354 (local address 127.17.18.125:42045)
0806 19:28:27.754786 (+ 5850us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.754794 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.755592 (+ 798us) server_negotiation.cc:407] Connection header received
0806 19:28:27.755771 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.755777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.755891 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.756055 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:27.756712 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.759180 (+ 2468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.763549 (+ 4369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.765742 (+ 2193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.765952 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.766277 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.766650 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.766861 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5607,"thread_start_us":5240,"threads_started":1}
I20260806 19:28:27.769236 27379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:27.769495 27446 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260806 19:28:27.770268 27488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b824c1f3834147f2833ca79b591ca786. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:27.770548 27488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: LEARNER
I20260806 19:28:27.771181 27379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:27.791887 27513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:27.791440 27517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:27.791548 27514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:27.794091 27379 server_base.cc:1034] running on GCE node
I20260806 19:28:27.795182 27379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:27.797278 27379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:27.798808 27379 hybrid_clock.cc:648] HybridClock initialized: now 1786044507798536 us; error 50 us; skew 500 ppm
I20260806 19:28:27.799448 27379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044507, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:27.804996 27379 init.cc:377] Logged in from keytab as oryx/127.17.18.124@KRBTEST.COM (short username oryx)
I20260806 19:28:27.808033 27379 webserver.cc:460] Webserver started at http://127.17.18.124:40499/ using document root <none> and password file <none>
I20260806 19:28:27.809244 27379 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:27.809649 27379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:27.810194 27379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:27.814996 27379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/instance:
uuid: "8d0931b1d6d74172bc7ab943861399a6"
format_stamp: "Formatted at 2026-08-06 19:28:27 on dist-test-slave-f0tn"
server_key: "08a58e97112977a68f447a5f6f068a51"
server_key_iv: "c0602000c0afd7677a00003b56650634"
server_key_version: "encryptionkey@0"
I20260806 19:28:27.816116 27379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal/instance:
uuid: "8d0931b1d6d74172bc7ab943861399a6"
format_stamp: "Formatted at 2026-08-06 19:28:27 on dist-test-slave-f0tn"
server_key: "08a58e97112977a68f447a5f6f068a51"
server_key_iv: "c0602000c0afd7677a00003b56650634"
server_key_version: "encryptionkey@0"
I20260806 19:28:27.824918 27379 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.001s
I20260806 19:28:27.831610 27531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:27.833695 27379 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.004s
I20260806 19:28:27.833976 27379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "8d0931b1d6d74172bc7ab943861399a6"
format_stamp: "Formatted at 2026-08-06 19:28:27 on dist-test-slave-f0tn"
server_key: "08a58e97112977a68f447a5f6f068a51"
server_key_iv: "c0602000c0afd7677a00003b56650634"
server_key_version: "encryptionkey@0"
I20260806 19:28:27.834308 27379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:27.858994 27379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:27.867158 27379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:27.867823 27379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:27.930599 27379 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.124:36899
I20260806 19:28:27.930799 27605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.124:36899 every 8 connection(s)
I20260806 19:28:27.932587 27379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
I20260806 19:28:27.938129 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 27379
I20260806 19:28:27.939394 27606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:27.954994 27606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044507, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.124@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:27.978915 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.941085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44684 (local address 127.17.18.124:36899)
0806 19:28:27.943176 (+ 2091us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.943188 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.943262 (+ 74us) server_negotiation.cc:407] Connection header received
0806 19:28:27.946960 (+ 3698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.946991 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.947539 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.947925 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.951221 (+ 3296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.953560 (+ 2339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.956330 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.957661 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.957976 (+ 315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.966987 (+ 9011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.966998 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.967013 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.967095 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.972812 (+ 5717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.973877 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.973886 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.973895 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.974198 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.974759 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.974763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.974765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.975496 (+ 731us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.975974 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.976481 (+ 507us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.977033 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1700,"thread_start_us":1225,"threads_started":1}
I20260806 19:28:27.987588 27611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.959902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41724 (local address 127.17.18.126:37961)
0806 19:28:27.961223 (+ 1321us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.961231 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.962623 (+ 1392us) server_negotiation.cc:407] Connection header received
0806 19:28:27.962897 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.962901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.962972 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.963176 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.966286 (+ 3110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.967825 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.970906 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.971652 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.971790 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.977464 (+ 5674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:27.977472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:27.977477 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:27.977557 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:27.983285 (+ 5728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.984434 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.984439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.984441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.984661 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:27.985159 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:27.985164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:27.985166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:27.985650 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:27.985804 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:27.986553 (+ 749us) server_negotiation.cc:299] Negotiation successful
0806 19:28:27.986786 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1022,"thread_start_us":788,"threads_started":1}
I20260806 19:28:27.987605 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.959945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41724)
0806 19:28:27.962432 (+ 2487us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.962493 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.962735 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.963248 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.963257 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.964927 (+ 1670us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.965951 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.965975 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.967991 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.967995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.970706 (+ 2711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.970727 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.972037 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.972048 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.972335 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.973202 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.973259 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:27.977153 (+ 3894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:27.983439 (+ 6286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.983452 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.983458 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.984281 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.984788 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:27.984792 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:27.984794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:27.985018 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:27.985795 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:27.985803 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:27.986088 (+ 285us) client_negotiation.cc:769] Sending connection context
0806 19:28:27.986354 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 19:28:27.986785 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2051,"thread_start_us":1662,"threads_started":1}
I20260806 19:28:27.989655 27606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:28:27 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044507, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.124@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
I20260806 19:28:28.010015 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.990979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46364)
0806 19:28:27.991207 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:27.991227 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:27.991333 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:27.991599 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:27.991602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:27.992286 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:27.992670 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.992683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.994141 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.994146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.995947 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:27.995965 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.997256 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.997262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:27.997562 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:27.998381 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:27.998402 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.001810 (+ 3408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.006827 (+ 5017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.006831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.006834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.007530 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.008050 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.008053 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.008057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.008268 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.008995 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.008999 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.009150 (+ 151us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.009280 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.009667 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 19:28:28.010382 27510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:27.990557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.17.18.125:42045)
0806 19:28:27.990837 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:27.990843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:27.991288 (+ 445us) server_negotiation.cc:407] Connection header received
0806 19:28:27.991423 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:27.991427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:27.991495 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:27.991576 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:27.992854 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.993985 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.996165 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:27.996985 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:27.997120 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.002071 (+ 4951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.002078 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.002082 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.002149 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.006645 (+ 4496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.007687 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.007693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.007696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.007936 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.008399 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.008403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.008406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.008868 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.009011 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.009436 (+ 425us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.009837 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:28:28.012022 27606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:28:28 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044507, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.124@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
I20260806 19:28:28.032897 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.013116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.0.0.1:44694)
0806 19:28:28.013440 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.013456 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.013574 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.013851 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.013855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.014551 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.014889 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.014902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.016310 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.016315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.017913 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.017928 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.019112 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.019119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.019595 (+ 476us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.020443 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.020461 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.023798 (+ 3337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.029131 (+ 5333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.029137 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.029142 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.029903 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.030442 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.030447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.030451 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.030784 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.031512 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.031517 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.031719 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.031859 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.032169 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 19:28:28.032927 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.013032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.17.18.124:36899)
0806 19:28:28.013262 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.013270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.013518 (+ 248us) server_negotiation.cc:407] Connection header received
0806 19:28:28.013670 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.013675 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.013737 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.013816 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.015038 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.016183 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.018050 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.018907 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.019030 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.024017 (+ 4987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.024022 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.024025 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.024069 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.028964 (+ 4895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.030043 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.030048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.030050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.030320 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.030906 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.030910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.030912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.031390 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.031533 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.032035 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.032426 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":62}
I20260806 19:28:28.040468 27606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Bootstrap starting.
I20260806 19:28:28.045888 27606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:28.048106 27606 log.cc:824] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:28.052577 27606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: No bootstrap required, opened a new log
I20260806 19:28:28.066774 27606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } }
I20260806 19:28:28.067385 27606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:28.067698 27606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d0931b1d6d74172bc7ab943861399a6, State: Initialized, Role: FOLLOWER
I20260806 19:28:28.068495 27606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } }
I20260806 19:28:28.070585 27615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } } }
I20260806 19:28:28.071527 27606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:28.071506 27615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:28.087301 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 26642
W20260806 19:28:28.094233 27628 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:28:28.094564 27628 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:28:28.096957 27379 master_runner.cc:428] Detected that this master 8d0931b1d6d74172bc7ab943861399a6 is joining an existing cluster
I20260806 19:28:28.097177 27379 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.18.124:36899
Aug 06 19:28:28 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.65@KRBTEST.COM
W20260806 19:28:28.122406 27540 tablet.cc:2369] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:28.130944 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.088976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36828 (local address 127.17.18.65:36143)
0806 19:28:28.093458 (+ 4482us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.093467 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.093502 (+ 35us) server_negotiation.cc:407] Connection header received
0806 19:28:28.093578 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.093587 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.093932 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.097033 (+ 3101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.097754 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.100174 (+ 2420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.103392 (+ 3218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.104867 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.105053 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.116232 (+ 11179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.116263 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.116285 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.116346 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.124047 (+ 7701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.125638 (+ 1591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.125652 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.125657 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.125976 (+ 319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.126725 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.126730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.126734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.127419 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.129544 (+ 2125us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.129837 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.130248 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4216,"thread_start_us":3978,"threads_started":1}
I20260806 19:28:28.133188 26818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:28.156790 27611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.106931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41726 (local address 127.17.18.126:37961)
0806 19:28:28.107452 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.107459 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.119524 (+ 12065us) server_negotiation.cc:407] Connection header received
0806 19:28:28.120444 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.120452 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.120558 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.120640 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.125673 (+ 5033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.127435 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.133566 (+ 6131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.134674 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.134795 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.140769 (+ 5974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.140780 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.140785 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.140839 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.146903 (+ 6064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.149982 (+ 3079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.149989 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.149994 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.150757 (+ 763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.151527 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.151533 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.151536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.152101 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.152274 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.155873 (+ 3599us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.156234 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357}
I20260806 19:28:28.157876 27643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.107252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41726)
0806 19:28:28.119346 (+ 12094us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.119376 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.120223 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.120881 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.120887 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.123918 (+ 3031us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.125411 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.125436 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.127866 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.127872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.133250 (+ 5378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.133267 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.135269 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.135280 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.135843 (+ 563us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.137133 (+ 1290us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.137162 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.140307 (+ 3145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.147208 (+ 6901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.147213 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.147218 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.149784 (+ 2566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.150941 (+ 1157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.150946 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.150950 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.151361 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.152382 (+ 1021us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.152387 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.155123 (+ 2736us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.155636 (+ 513us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.156231 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11742,"mutex_wait_us":31,"thread_start_us":20436,"threads_started":1}
I20260806 19:28:28.174113 27510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.109881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46378 (local address 127.17.18.125:42045)
0806 19:28:28.110135 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.110141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.133285 (+ 23144us) server_negotiation.cc:407] Connection header received
0806 19:28:28.133657 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.133666 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.133771 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.133847 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.141831 (+ 7984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.143576 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.147399 (+ 3823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.148327 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.148465 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.161038 (+ 12573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.161049 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.161054 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.161101 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.168916 (+ 7815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.170120 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.170127 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.170131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.170437 (+ 306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.171064 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.171070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.171074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.171567 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.171734 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.172895 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.173439 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 19:28:28.174274 27639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.108535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.0.0.1:44700)
0806 19:28:28.129909 (+ 21374us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.129933 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.130155 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.130995 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.130999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.133680 (+ 2681us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.135394 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.135412 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.139366 (+ 3954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.139372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.151398 (+ 12026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.151411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.153709 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.153721 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.154238 (+ 517us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.155477 (+ 1239us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.155502 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.159178 (+ 3676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.167698 (+ 8520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.167704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.167708 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.170164 (+ 2456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.170705 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.170710 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.170714 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.170960 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.172256 (+ 1296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.172262 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.172499 (+ 237us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.172694 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.173246 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19865,"mutex_wait_us":6496,"thread_start_us":21804,"threads_started":1}
I20260806 19:28:28.175736 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.107223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44700 (local address 127.17.18.124:36899)
0806 19:28:28.107702 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.107708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.130029 (+ 22321us) server_negotiation.cc:407] Connection header received
0806 19:28:28.130460 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.130466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.130553 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.130615 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.135573 (+ 4958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.137946 (+ 2373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.151538 (+ 13592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.152928 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.153018 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.159489 (+ 6471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.159498 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.159502 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.159544 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.167476 (+ 7932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.170311 (+ 2835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.170317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.170322 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.170562 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.171084 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.171089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.171093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.171923 (+ 830us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.172193 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.174669 (+ 2476us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.174948 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":259}
I20260806 19:28:28.176934 27642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.111235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46378)
0806 19:28:28.133052 (+ 21817us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.133074 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.133450 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.134380 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.134386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.139865 (+ 5479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.141462 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.141482 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.143955 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.143962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.147177 (+ 3215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.147200 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.149322 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.149337 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.149724 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.150955 (+ 1231us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.151108 (+ 153us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.160663 (+ 9555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.169165 (+ 8502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.169171 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.169175 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.169956 (+ 781us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.170607 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.170612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.170616 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.170922 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.171831 (+ 909us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.171836 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.172472 (+ 636us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.174864 (+ 2392us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.175438 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21652,"mutex_wait_us":3,"spinlock_wait_cycles":51072,"thread_start_us":8316,"threads_started":1}
Aug 06 19:28:28 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.126@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
I20260806 19:28:28.201038 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.169439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.0.0.1:44714)
0806 19:28:28.169619 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.169644 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.169764 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.176624 (+ 6860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.176630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.177505 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.177914 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.177936 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.179887 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.179893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.182098 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.182128 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.184230 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.184239 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.184663 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.185749 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.185775 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.190267 (+ 4492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.197081 (+ 6814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.197087 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.197092 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.197936 (+ 844us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.198521 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.198526 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.198530 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.198832 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.199563 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.199570 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.199855 (+ 285us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.200016 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.200380 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 19:28:28.201561 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.169893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44714 (local address 127.17.18.124:36899)
0806 19:28:28.176008 (+ 6115us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.176014 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.176030 (+ 16us) server_negotiation.cc:407] Connection header received
0806 19:28:28.176229 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.176234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.176395 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.177470 (+ 1075us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.178105 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.179683 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.182407 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.183955 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.185184 (+ 1229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.190574 (+ 5390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.190583 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.190588 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.190630 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.196824 (+ 6194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.198095 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.198102 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.198106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.198377 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.198965 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.198971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.198975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.199429 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.199587 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.200154 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.200497 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6011,"thread_start_us":20093,"threads_started":1}
I20260806 19:28:28.203685 26551 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.18.124:36899: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6"
member_type: NON_VOTER
last_known_addr {
host: "127.17.18.124"
port: 36899
}
attrs {
promote: true
}
}
dest_uuid: "b824c1f3834147f2833ca79b591ca786"
cas_config_opid_index: 5
I20260806 19:28:28.205130 26551 consensus_queue.cc:237] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
I20260806 19:28:28.209587 27446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 19:28:28.210613 27507 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 19:28:28.213430 27566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:28.220500 27566 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 19:28:28.222025 27507 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:28.224979 27507 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.233878 27507 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.18.124:36899
I20260806 19:28:28.235124 27379 master.cc:537] Master@127.17.18.124:36899 shutting down...
I20260806 19:28:28.253539 27563 raft_consensus.cc:858] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
W20260806 19:28:28.253814 27563 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
I20260806 19:28:28.262058 27652 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.263072 27652 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:28.262501 27446 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.267771 27488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.268154 27488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: LEARNER
I20260806 19:28:28.274106 27648 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: attempting to promote NON_VOTER 88db63cf13d045afa40beb78869712aa to VOTER
I20260806 19:28:28.280002 27648 consensus_queue.cc:237] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
I20260806 19:28:28.285180 27446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 LEARNER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 19:28:28.289292 27657 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260806 19:28:28.297369 27446 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 88db63cf13d045afa40beb78869712aa (127.17.18.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.305532 27488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.305998 27488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:28.308477 27652 raft_consensus.cc:1013] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: attempt to promote peer 88db63cf13d045afa40beb78869712aa: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260806 19:28:28.308313 27507 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.308743 27507 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:28.310623 27654 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 88db63cf13d045afa40beb78869712aa (127.17.18.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
W20260806 19:28:28.323383 26530 consensus_peers.cc:487] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 -> Peer 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124:36899): Couldn't send request to peer 8d0931b1d6d74172bc7ab943861399a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 19:28:28.331463 27648 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.332091 27648 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:28.332752 27648 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.333261 27648 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:28.340880 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 26642
I20260806 19:28:28.369531 27563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 88db63cf13d045afa40beb78869712aa (127.17.18.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:28.376606 27615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b824c1f3834147f2833ca79b591ca786. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
W20260806 19:28:28.376729 26533 connection.cc:535] server connection from 127.17.18.65:43113 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 19:28:28.376937 27615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 19:28:28.377260 27659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:28.377717 27659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 19:28:28.378106 27664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: NON_VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: true } } }
I20260806 19:28:28.378463 27664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260806 19:28:28.378458 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:36143
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:37961
--webserver_port=37539
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:28:28.383520 27379 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260806 19:28:28.384065 27379 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260806 19:28:28.384276 27379 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: stopping tablet replica
I20260806 19:28:28.404553 27379 master.cc:552] Master@127.17.18.124:36899 shutdown complete.
I20260806 19:28:28.404675 27379 master_runner.cc:305] Clearing existing system tablet
I20260806 19:28:28.405144 27379 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:28.405285 27379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:28.410285 27379 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:28.412371 27672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:28.412801 27379 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:28.413094 27379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:28.413203 27379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "8d0931b1d6d74172bc7ab943861399a6"
format_stamp: "Formatted at 2026-08-06 19:28:27 on dist-test-slave-f0tn"
server_key: "08a58e97112977a68f447a5f6f068a51"
server_key_iv: "c0602000c0afd7677a00003b56650634"
server_key_version: "encryptionkey@0"
I20260806 19:28:28.419291 27379 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:28.430828 27379 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 19:28:28.431134 27379 log.cc:1196] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 19:28:28.432150 27379 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Deleting consensus metadata
I20260806 19:28:28.432502 27379 master_runner.cc:315] Copying system tablet from 127.17.18.126:37961
I20260806 19:28:28.437558 27379 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: tablet copy: Beginning tablet copy session from remote peer at address 127.17.18.126:37961
I20260806 19:28:28.468127 27611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.438699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41734 (local address 127.17.18.126:37961)
0806 19:28:28.438917 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.438923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.440582 (+ 1659us) server_negotiation.cc:407] Connection header received
0806 19:28:28.440943 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.440950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.441054 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.441131 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:28.443377 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.445357 (+ 1980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.449811 (+ 4454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.451086 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.451239 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.456894 (+ 5655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:28.456907 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:28.456913 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:28.456995 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:28.463535 (+ 6540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.464589 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.464596 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.464601 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.464890 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:28.465595 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:28.465601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:28.465604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:28.466167 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:28.466322 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.467260 (+ 938us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.467528 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 19:28:28.470414 27682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.438782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:41734)
0806 19:28:28.440433 (+ 1651us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.440462 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.440733 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.441370 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.441405 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.442356 (+ 951us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:28.443146 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.443168 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.446934 (+ 3766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.446941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.449538 (+ 2597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.449565 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.451762 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.451771 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.452251 (+ 480us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.453442 (+ 1191us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:28.453517 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:28.456333 (+ 2816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:28.463777 (+ 7444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.463783 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.463788 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.464416 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.465071 (+ 655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:28.465080 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:28.465083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:28.465436 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:28.466419 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:28.466425 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:28.466754 (+ 329us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.468653 (+ 1899us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.469291 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1496,"thread_start_us":1206,"threads_started":1}
I20260806 19:28:28.471300 26576 tablet_copy_service.cc:140] P b824c1f3834147f2833ca79b591ca786: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8d0931b1d6d74172bc7ab943861399a6 ({username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:41734)
I20260806 19:28:28.471552 26576 tablet_copy_service.cc:161] P b824c1f3834147f2833ca79b591ca786: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8d0931b1d6d74172bc7ab943861399a6 at {username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:41734: session id = 8d0931b1d6d74172bc7ab943861399a6-00000000000000000000000000000000
I20260806 19:28:28.475620 26576 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 19:28:28.478305 27379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 19:28:28.489490 27379 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: tablet copy: Starting download of 0 data blocks...
I20260806 19:28:28.490140 27379 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: tablet copy: Starting download of 1 WAL segments...
I20260806 19:28:28.494037 27379 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 19:28:28.499754 26576 tablet_copy_service.cc:342] P b824c1f3834147f2833ca79b591ca786: Request end of tablet copy session 8d0931b1d6d74172bc7ab943861399a6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:41734
I20260806 19:28:28.500056 26576 tablet_copy_service.cc:433] P b824c1f3834147f2833ca79b591ca786: ending tablet copy session 8d0931b1d6d74172bc7ab943861399a6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8d0931b1d6d74172bc7ab943861399a6
I20260806 19:28:28.517242 27379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:28.525370 27687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:28.529146 27689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:28.530042 27685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:28.535398 27379 server_base.cc:1034] running on GCE node
I20260806 19:28:28.535920 27379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:28.536816 27379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:28.538055 27379 hybrid_clock.cc:648] HybridClock initialized: now 1786044508538001 us; error 42 us; skew 500 ppm
I20260806 19:28:28.538448 27379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:28 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044508, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:28.541127 27379 init.cc:377] Logged in from keytab as oryx/127.17.18.124@KRBTEST.COM (short username oryx)
I20260806 19:28:28.547060 27379 webserver.cc:460] Webserver started at http://127.17.18.124:45565/ using document root <none> and password file <none>
I20260806 19:28:28.547796 27379 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:28.548097 27379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:28.553992 27379 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 19:28:28.557156 27698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:28.557757 27379 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:28.558019 27379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "8d0931b1d6d74172bc7ab943861399a6"
format_stamp: "Formatted at 2026-08-06 19:28:27 on dist-test-slave-f0tn"
server_key: "08a58e97112977a68f447a5f6f068a51"
server_key_iv: "c0602000c0afd7677a00003b56650634"
server_key_version: "encryptionkey@0"
I20260806 19:28:28.558503 27379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:28.573235 27379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:28.577564 27379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:28.632378 27379 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.124:36899
I20260806 19:28:28.632445 27768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.124:36899 every 8 connection(s)
I20260806 19:28:28.633538 27379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
I20260806 19:28:28.638819 27770 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:28:28.642892 27770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Bootstrap starting.
I20260806 19:28:28.660665 27770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:28:28.661262 27770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Bootstrap complete.
I20260806 19:28:28.662485 27770 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
I20260806 19:28:28.662791 27770 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8d0931b1d6d74172bc7ab943861399a6, State: Initialized, Role: LEARNER
I20260806 19:28:28.663080 27770 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } }
I20260806 19:28:28.663975 27776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.664357 27770 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:28.664413 27776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: LEARNER
I20260806 19:28:28.678082 27794 catalog_manager.cc:1259] Loaded cluster ID: 5dbfebd39ad64c6c97e91694e0f16bfd
I20260806 19:28:28.678217 27794 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: loading cluster ID for follower catalog manager: success
I20260806 19:28:28.682147 27794 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: acquiring CA information for follower catalog manager: success
I20260806 19:28:28.685007 27794 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:28:28.838402 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.829245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.0.0.1:44730)
0806 19:28:28.830240 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:28.830264 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:28.830425 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:28.831012 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:28.831018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:28.831052 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:28.831310 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.831324 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.833516 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.833523 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.835503 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:28.835532 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.837482 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.837490 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:28.837706 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.837748 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 19:28:28.837870 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 19:28:28.838038 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":669,"threads_started":1}
I20260806 19:28:28.838446 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:28.829485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44730 (local address 127.17.18.124:36899)
0806 19:28:28.830578 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:28.830585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:28.830610 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:28:28.830692 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:28.830697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:28.830796 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:28.830937 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:28.831531 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.833286 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.835807 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:28.837202 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:28.837420 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:28.837747 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:28.837915 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 19:28:28.838077 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":909,"thread_start_us":755,"threads_started":1}
I20260806 19:28:28.839821 27735 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 19:28:28.840354 27776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b824c1f3834147f2833ca79b591ca786. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:28.840677 27776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: LEARNER
W20260806 19:28:28.903198 27667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:28.903644 27667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:28.903893 27667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:28.916883 27667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:28.917189 27667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:28.917532 27667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:28.933148 27667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:36143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=37539
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:28.935252 27667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:28.937096 27667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:28.959949 27806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:28.960886 27807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:28.961151 27809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:28.963219 27667 server_base.cc:1034] running on GCE node
I20260806 19:28:28.964277 27667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:28.965804 27667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:28.967155 27667 hybrid_clock.cc:648] HybridClock initialized: now 1786044508966990 us; error 61 us; skew 500 ppm
I20260806 19:28:28.967674 27667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:28 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044508, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:28.973040 27667 init.cc:377] Logged in from keytab as oryx/127.17.18.65@KRBTEST.COM (short username oryx)
I20260806 19:28:28.976171 27667 webserver.cc:460] Webserver started at http://127.17.18.65:37539/ using document root <none> and password file <none>
I20260806 19:28:28.977540 27667 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:28.977849 27667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:28.986769 27667 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 19:28:28.992086 27820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:28.994298 27667 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:28:28.994566 27667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5459b6162100402e97bbecb5497470bc"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "4883079358051121d264203eb5080562"
server_key_iv: "3db47592d79cf454f32bd3d4c63bb31d"
server_key_version: "encryptionkey@0"
I20260806 19:28:28.996395 27667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:29.026266 27667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:29.033514 27667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:29.034195 27667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:29.036317 27667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:29.039024 27667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:29.039269 27667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:29.039438 27667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:29.039649 27667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:29.159170 27667 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:36143
I20260806 19:28:29.159533 27984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:36143 every 8 connection(s)
I20260806 19:28:29.161274 27667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:29.169080 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 27667
I20260806 19:28:29.169616 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 26832
Aug 06 19:28:29 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044508, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
Aug 06 19:28:29 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044508, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
Aug 06 19:28:29 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044508, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
Aug 06 19:28:29 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.66@KRBTEST.COM
I20260806 19:28:29.218696 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.166269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56867 (local address 127.17.18.124:36899)
0806 19:28:29.166481 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.166489 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.182792 (+ 16303us) server_negotiation.cc:407] Connection header received
0806 19:28:29.184198 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.184204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.184308 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.184412 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:29.193323 (+ 8911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.194879 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.198014 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.199188 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.199347 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.206721 (+ 7374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:29.206733 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:29.206739 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:29.206796 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:29.212588 (+ 5792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.214152 (+ 1564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.214159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.214163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.214533 (+ 370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.215441 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.215448 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.215451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.215991 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:29.216152 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:29.217519 (+ 1367us) server_negotiation.cc:299] Negotiation successful
0806 19:28:29.217920 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 19:28:29.219081 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.166224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:38121 (local address 127.17.18.126:37961)
0806 19:28:29.167245 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.167251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.173490 (+ 6239us) server_negotiation.cc:407] Connection header received
0806 19:28:29.185577 (+ 12087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.185583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.185680 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.186017 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:29.190850 (+ 4833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.192454 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.195646 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.196352 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.196467 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.205328 (+ 8861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:29.205341 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:29.205347 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:29.205432 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:29.212553 (+ 7121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.214152 (+ 1599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.214159 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.214163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.214545 (+ 382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.215453 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.215458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.215461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.216003 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:29.216152 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:29.217729 (+ 1577us) server_negotiation.cc:299] Negotiation successful
0806 19:28:29.218014 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":791,"thread_start_us":618,"threads_started":1}
I20260806 19:28:29.219187 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.176227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48693 (local address 127.17.18.125:42045)
0806 19:28:29.181911 (+ 5684us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.181917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.188505 (+ 6588us) server_negotiation.cc:407] Connection header received
0806 19:28:29.188642 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.188648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.188794 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.189017 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:29.194895 (+ 5878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.196594 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.199462 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.200266 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.200398 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.207318 (+ 6920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:29.207327 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:29.207332 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:29.207385 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:29.213330 (+ 5945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.214723 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.214730 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.214733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.215005 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.215685 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.215690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.215694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.216183 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:29.216336 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:29.217976 (+ 1640us) server_negotiation.cc:299] Negotiation successful
0806 19:28:29.218253 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5532,"thread_start_us":5356,"threads_started":1}
I20260806 19:28:29.222056 27654 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: NON_VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: true } } }
I20260806 19:28:29.222720 27654 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:29.227377 28001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.177178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.17.18.65:48693)
0806 19:28:29.188245 (+ 11067us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:29.188266 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:29.188511 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:29.189427 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:29.189432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:29.193581 (+ 4149us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:29.194682 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.194700 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.196823 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.196828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.199281 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.199296 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.200974 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.200985 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.201346 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.202188 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:29.202228 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:29.206890 (+ 4662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:29.213582 (+ 6692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.213587 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.213591 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.214539 (+ 948us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.215174 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.215180 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.215184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.215527 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.216408 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:29.216414 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:29.216925 (+ 511us) client_negotiation.cc:769] Sending connection context
0806 19:28:29.217335 (+ 410us) client_negotiation.cc:240] Negotiation successful
0806 19:28:29.219777 (+ 2442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10797,"mutex_wait_us":26,"thread_start_us":5830,"threads_started":1}
I20260806 19:28:29.227555 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.172093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.17.18.65:56867)
0806 19:28:29.182405 (+ 10312us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:29.182430 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:29.183705 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:29.185155 (+ 1450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:29.185171 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:29.189340 (+ 4169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:29.193045 (+ 3705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.193069 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.195104 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.195110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.197780 (+ 2670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.197797 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.199906 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.199917 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.200267 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.201224 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:29.201254 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:29.206307 (+ 5053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:29.212813 (+ 6506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.212827 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.212852 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.213961 (+ 1109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.214732 (+ 771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.214737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.214741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.215254 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.216320 (+ 1066us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:29.216330 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:29.216924 (+ 594us) client_negotiation.cc:769] Sending connection context
0806 19:28:29.219059 (+ 2135us) client_negotiation.cc:240] Negotiation successful
0806 19:28:29.219534 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10071,"mutex_wait_us":81,"spinlock_wait_cycles":86400,"thread_start_us":2895,"threads_started":1}
I20260806 19:28:29.227347 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.167491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:38121)
0806 19:28:29.172917 (+ 5426us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:29.173114 (+ 197us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:29.184250 (+ 11136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:29.186290 (+ 2040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:29.186295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:29.189306 (+ 3011us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:29.190634 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.190658 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.192761 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.192769 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.195404 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:29.195427 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.196870 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.196879 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:29.197347 (+ 468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.198535 (+ 1188us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:29.198576 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:29.204795 (+ 6219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:29.212813 (+ 8018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.212827 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.212852 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.213959 (+ 1107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.214732 (+ 773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:29.214737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:29.214741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:29.215306 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:29.216320 (+ 1014us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:29.216330 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:29.216924 (+ 594us) client_negotiation.cc:769] Sending connection context
0806 19:28:29.219376 (+ 2452us) client_negotiation.cc:240] Negotiation successful
0806 19:28:29.219994 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1709,"mutex_wait_us":304,"spinlock_wait_cycles":8448,"thread_start_us":1988,"threads_started":1}
I20260806 19:28:29.230384 27985 heartbeater.cc:347] Connected to a master server at 127.17.18.124:36899
I20260806 19:28:29.230492 27987 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:29.230576 27988 heartbeater.cc:347] Connected to a master server at 127.17.18.125:42045
I20260806 19:28:29.230883 27987 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:29.230883 27988 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:29.230916 27985 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:29.231129 28002 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: attempting to promote NON_VOTER 8d0931b1d6d74172bc7ab943861399a6 to VOTER
I20260806 19:28:29.232168 28002 consensus_queue.cc:237] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:29.233811 27988 heartbeater.cc:511] Master 127.17.18.125:42045 requested a full tablet report, sending...
I20260806 19:28:29.233985 27987 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:29.234925 27985 heartbeater.cc:511] Master 127.17.18.124:36899 requested a full tablet report, sending...
I20260806 19:28:29.235250 27735 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 LEARNER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 19:28:29.235874 27446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Refusing update from remote peer b824c1f3834147f2833ca79b591ca786: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 19:28:29.236202 28003 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260806 19:28:29.237852 28002 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 19:28:29.238066 27721 ts_manager.cc:194] Registered new tserver with Master: 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
I20260806 19:28:29.238111 26551 ts_manager.cc:194] Re-registered known tserver with Master: 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
I20260806 19:28:29.238878 27428 ts_manager.cc:194] Registered new tserver with Master: 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
I20260806 19:28:29.239756 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:38121
I20260806 19:28:29.240633 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.170679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45282 (local address 127.17.18.66:45657)
0806 19:28:29.172471 (+ 1792us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.172491 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.173620 (+ 1129us) server_negotiation.cc:407] Connection header received
0806 19:28:29.174062 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.174075 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.174384 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.188898 (+ 14514us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:29.193290 (+ 4392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.195911 (+ 2621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.199179 (+ 3268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:29.200562 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:29.201080 (+ 518us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:29.213187 (+ 12107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:29.213217 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:29.213241 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:29.213292 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:29.223571 (+ 10279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.227066 (+ 3495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.227081 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.227099 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.231687 (+ 4588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:29.232496 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:29.232502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:29.232506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:29.233190 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:29.233683 (+ 493us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:29.235909 (+ 2226us) server_negotiation.cc:299] Negotiation successful
0806 19:28:29.239807 (+ 3898us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1555,"thread_start_us":1299,"threads_started":1}
I20260806 19:28:29.243377 27012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:29.245440 28002 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.246733 27446 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.249828 28003 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.250029 28002 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.250566 28003 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:29.250804 28002 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:29.253175 27654 sys_catalog.cc:455] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.253676 27654 sys_catalog.cc:458] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:29.254021 27735 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.258875 27776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.259320 27776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:29.260433 28009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b824c1f3834147f2833ca79b591ca786" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:29.261148 28009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:29.344703 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 26832
I20260806 19:28:29.370698 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:45657
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:37961
--webserver_port=45313
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:29.842931 28010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:29.843262 28010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:29.843360 28010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:29.850826 28010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:29.850956 28010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:29.851073 28010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:29.861498 28010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:45657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=45313
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:29.862986 28010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:29.864346 28010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:29.879140 28019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:29.879274 28022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:29.879490 28020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:29.880328 28010 server_base.cc:1034] running on GCE node
I20260806 19:28:29.881304 28010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:29.882963 28010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:29.884191 28010 hybrid_clock.cc:648] HybridClock initialized: now 1786044509884140 us; error 46 us; skew 500 ppm
I20260806 19:28:29.884526 28010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:29 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:29.888000 28010 init.cc:377] Logged in from keytab as oryx/127.17.18.66@KRBTEST.COM (short username oryx)
I20260806 19:28:29.889876 28010 webserver.cc:460] Webserver started at http://127.17.18.66:45313/ using document root <none> and password file <none>
I20260806 19:28:29.890653 28010 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:29.890797 28010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:29.896564 28010 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260806 19:28:29.899662 28032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:29.901270 28010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:28:29.901491 28010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "2875509ec9d646808d2b9ff6aca12c3e"
format_stamp: "Formatted at 2026-08-06 19:28:25 on dist-test-slave-f0tn"
server_key: "94851284b68ae6580f54c5f9b73268d9"
server_key_iv: "d4c8f971905f6128c2a7150ed23deaf1"
server_key_version: "encryptionkey@0"
I20260806 19:28:29.902631 28010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:29.925241 28010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:29.931442 28010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:29.931825 28010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:29.933192 28010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:29.935758 28010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:29.935856 28010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:29.935983 28010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:29.936060 28010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:29.984970 28010 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45657
I20260806 19:28:29.985110 28190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45657 every 8 connection(s)
I20260806 19:28:29.986970 28010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:29.993836 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 28010
I20260806 19:28:29.994163 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 27026
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.67@KRBTEST.COM
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044509, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:30.022768 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.991576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:58559 (local address 127.17.18.126:37961)
0806 19:28:29.992812 (+ 1236us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.992819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.002381 (+ 9562us) server_negotiation.cc:407] Connection header received
0806 19:28:30.002674 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.002680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.002786 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.002954 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.006056 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.007139 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.009628 (+ 2489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.010365 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.010520 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.014813 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.014820 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.014825 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.014870 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.018157 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.019718 (+ 1561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.019725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.019728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.019894 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.020459 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.020465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.020469 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.020844 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.020999 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.022104 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.022395 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1101,"thread_start_us":985,"threads_started":1}
I20260806 19:28:30.023042 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.990812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:58009 (local address 127.17.18.124:36899)
0806 19:28:29.991691 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.991698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.994796 (+ 3098us) server_negotiation.cc:407] Connection header received
0806 19:28:29.999637 (+ 4841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.999652 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.999753 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.001928 (+ 2175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.003768 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.004633 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.007946 (+ 3313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.008623 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.008746 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.014350 (+ 5604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.014358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.014363 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.014411 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.018156 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.019731 (+ 1575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.019737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.019740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.019928 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.020509 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.020516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.020519 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.020852 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.021005 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.022409 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.022663 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":611,"threads_started":1}
I20260806 19:28:30.024343 28209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.995425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56464 (local address 127.17.18.67:33689)
0806 19:28:29.996250 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.996260 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.996292 (+ 32us) server_negotiation.cc:407] Connection header received
0806 19:28:29.996364 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.996371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.996575 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.996778 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:29.999784 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.001671 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.005065 (+ 3394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.006092 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.011952 (+ 5860us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.015005 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.015024 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.015041 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.015079 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.019631 (+ 4552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.020572 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.020583 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.020586 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.020752 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.021259 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.021265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.021268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.021824 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.022122 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.023471 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.023783 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":462,"threads_started":1}
I20260806 19:28:30.024415 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.996303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:58559)
0806 19:28:30.002148 (+ 5845us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.002168 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.002499 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.004496 (+ 1997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.004501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.005429 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.005828 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.005843 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.007497 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.007503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.009157 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.009176 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.010712 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.010722 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.010961 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.011867 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.011889 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.014580 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.018361 (+ 3781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.018369 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.018386 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.019584 (+ 1198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.020017 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.020022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.020026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.020323 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.020960 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.020968 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.021499 (+ 531us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.021980 (+ 481us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.022592 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5677,"mutex_wait_us":25,"spinlock_wait_cycles":10240,"thread_start_us":577,"threads_started":1}
I20260806 19:28:30.024454 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.991222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.17.18.66:58009)
0806 19:28:29.994388 (+ 3166us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:29.994419 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:29.999237 (+ 4818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.000561 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.000575 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.001790 (+ 1215us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.003569 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.003583 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.004838 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.004842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.007723 (+ 2881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.007741 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.009152 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.009161 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.010764 (+ 1603us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.011382 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.011412 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.014036 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.018363 (+ 4327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.018373 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.018389 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.019108 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.020088 (+ 980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.020093 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.020096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.020355 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.021073 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.021078 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.021501 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.021980 (+ 479us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.023533 (+ 1553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3000,"mutex_wait_us":3327,"spinlock_wait_cycles":45184,"thread_start_us":2184,"threads_started":1}
I20260806 19:28:30.025424 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.991796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:42557 (local address 127.17.18.125:42045)
0806 19:28:29.993408 (+ 1612us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:29.993416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:29.996460 (+ 3044us) server_negotiation.cc:407] Connection header received
0806 19:28:29.999635 (+ 3175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:29.999641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:29.999745 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:29.999923 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.003363 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.004472 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.007947 (+ 3475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.008619 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.008735 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.015591 (+ 6856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.015599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.015604 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.015668 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.019363 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.021417 (+ 2054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.021424 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.021427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.021609 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.023654 (+ 2045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.023660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.023663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.024100 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.024249 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.024847 (+ 598us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.025059 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1444,"thread_start_us":4304,"threads_started":1}
I20260806 19:28:30.026616 28192 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:30.026696 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:29.991222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.17.18.66:42557)
0806 19:28:29.992309 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:29.992368 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:29.999254 (+ 6886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.000561 (+ 1307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.000575 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.001794 (+ 1219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.003090 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.003130 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.004712 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.004718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.007723 (+ 3005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.007741 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.009152 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.009161 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.009660 (+ 499us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.010524 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.010576 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.014498 (+ 3922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.019525 (+ 5027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.019531 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.019535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.021229 (+ 1694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.021797 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.021802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.021805 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.023500 (+ 1695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.024335 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.024344 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.024523 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.025868 (+ 1345us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.026190 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"mutex_wait_us":179,"spinlock_wait_cycles":35072,"thread_start_us":988,"threads_started":1}
I20260806 19:28:30.027034 27203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:30.027055 28192 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.027851 28195 heartbeater.cc:347] Connected to a master server at 127.17.18.125:42045
I20260806 19:28:30.028002 28195 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.028172 28192 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:30.028537 28195 heartbeater.cc:511] Master 127.17.18.125:42045 requested a full tablet report, sending...
I20260806 19:28:30.029677 28191 heartbeater.cc:347] Connected to a master server at 127.17.18.124:36899
I20260806 19:28:30.029814 28191 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.030215 28191 heartbeater.cc:511] Master 127.17.18.124:36899 requested a full tablet report, sending...
I20260806 19:28:30.030316 26551 ts_manager.cc:194] Re-registered known tserver with Master: 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:30.031407 27428 ts_manager.cc:194] Registered new tserver with Master: 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:30.031419 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:58559
I20260806 19:28:30.032563 27721 ts_manager.cc:194] Registered new tserver with Master: 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:30.115589 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 27026
I20260806 19:28:30.142438 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:33689
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:37961
--webserver_port=39821
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:28:30.244454 27987 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
W20260806 19:28:30.501041 28214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:30.501353 28214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:30.501510 28214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:30.509106 28214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:30.509236 28214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:30.509364 28214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:30.521927 28214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:33689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=39821
--tserver_master_addrs=127.17.18.126:37961,127.17.18.125:42045,127.17.18.124:36899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:30.523339 28214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:30.524857 28214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:30.539129 28223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:30.539188 28228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:30.539163 28225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:30.540787 28214 server_base.cc:1034] running on GCE node
I20260806 19:28:30.541541 28214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:30.542671 28214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:30.543926 28214 hybrid_clock.cc:648] HybridClock initialized: now 1786044510543865 us; error 49 us; skew 500 ppm
I20260806 19:28:30.544297 28214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:30.551222 28214 init.cc:377] Logged in from keytab as oryx/127.17.18.67@KRBTEST.COM (short username oryx)
I20260806 19:28:30.553041 28214 webserver.cc:460] Webserver started at http://127.17.18.67:39821/ using document root <none> and password file <none>
I20260806 19:28:30.553915 28214 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:30.554080 28214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:30.560534 28214 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 19:28:30.563993 28239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:30.565744 28214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:30.565941 28214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "c00f151cd42040c38c43f5dbeffaa504"
format_stamp: "Formatted at 2026-08-06 19:28:26 on dist-test-slave-f0tn"
server_key: "a57ace2a7d667045e05bfb3e09796c36"
server_key_iv: "49014a212518aeccc439e440c86fd050"
server_key_version: "encryptionkey@0"
I20260806 19:28:30.566985 28214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:30.581283 28214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:30.586287 28214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:30.586589 28214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:30.587776 28214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:30.589465 28214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:30.589576 28214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:30.589704 28214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:30.589780 28214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:30.624421 28214 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:33689
I20260806 19:28:30.624523 28397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:33689 every 8 connection(s)
I20260806 19:28:30.626165 28214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:30.631888 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 28214
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.125@KRBTEST.COM
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
Aug 06 19:28:30 dist-test-slave-f0tn krb5kdc[26487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044510, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.124@KRBTEST.COM
I20260806 19:28:30.667408 28407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.629584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:43269 (local address 127.17.18.124:36899)
0806 19:28:30.631065 (+ 1481us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.631072 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.638324 (+ 7252us) server_negotiation.cc:407] Connection header received
0806 19:28:30.643273 (+ 4949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.643280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.643360 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.643527 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.645432 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.646595 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.648814 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.649408 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.649545 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.660220 (+ 10675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.660230 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.660235 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.660282 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.663997 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.665068 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.665074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.665077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.665252 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.665753 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.665758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.665761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.666041 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.666138 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.666776 (+ 638us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.667018 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1347,"thread_start_us":1203,"threads_started":1}
I20260806 19:28:30.667586 28409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.630371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:47135 (local address 127.17.18.125:42045)
0806 19:28:30.641835 (+ 11464us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.641841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.642070 (+ 229us) server_negotiation.cc:407] Connection header received
0806 19:28:30.642297 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.642303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.642387 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.642579 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.645477 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.646606 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.649364 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.649968 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.650087 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.656982 (+ 6895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.656991 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.656996 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.657050 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.662617 (+ 5567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.664318 (+ 1701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.664324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.664327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.664506 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.665149 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.665154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.665157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.665599 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.665746 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.666897 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.667178 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11161,"thread_start_us":11356,"threads_started":1}
I20260806 19:28:30.668784 28414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.630188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.17.18.67:43269)
0806 19:28:30.638056 (+ 7868us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.638136 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.643090 (+ 4954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.643711 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.643716 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.644323 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.645183 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.645207 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.646826 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.646831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.648630 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.648665 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.649671 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.649678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.649984 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.655285 (+ 5301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.655310 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.659174 (+ 3864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.664414 (+ 5240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.664418 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.664420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.664926 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.665433 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.665437 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.665441 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.665619 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.666216 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.666219 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.666366 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.666697 (+ 331us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.667278 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7513,"mutex_wait_us":1,"spinlock_wait_cycles":11008,"thread_start_us":11123,"threads_started":1}
I20260806 19:28:30.669476 28410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.630187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.17.18.67:47135)
0806 19:28:30.641769 (+ 11582us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.641788 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.642154 (+ 366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.642969 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.642985 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.644324 (+ 1339us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.645184 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.645208 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.647465 (+ 2257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.647470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.649203 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.649219 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.650177 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.650184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.650745 (+ 561us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.651324 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.651358 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.656712 (+ 5354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.663386 (+ 6674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.663397 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.663419 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.664161 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.664690 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.664695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.664699 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.665030 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.665844 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.665853 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.666367 (+ 514us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.666696 (+ 329us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.668961 (+ 2265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11400,"mutex_wait_us":528,"spinlock_wait_cycles":9600,"thread_start_us":6965,"threads_started":1}
I20260806 19:28:30.670670 28398 heartbeater.cc:347] Connected to a master server at 127.17.18.124:36899
I20260806 19:28:30.670776 28402 heartbeater.cc:347] Connected to a master server at 127.17.18.125:42045
I20260806 19:28:30.671036 28398 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.671038 28402 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.672184 28398 heartbeater.cc:511] Master 127.17.18.124:36899 requested a full tablet report, sending...
I20260806 19:28:30.672194 28402 heartbeater.cc:511] Master 127.17.18.125:42045 requested a full tablet report, sending...
I20260806 19:28:30.673877 28412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.630206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:52479)
0806 19:28:30.638824 (+ 8618us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.638842 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.640780 (+ 1938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.645186 (+ 4406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.645190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.645695 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:30.645902 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.645911 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.647689 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.647694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.650357 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.650371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.651406 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.651413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.651611 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.652227 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:30.652252 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:30.663210 (+ 10958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:30.667800 (+ 4590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.667851 (+ 51us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.667859 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.668388 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.669640 (+ 1252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:30.669645 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:30.669648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:30.670142 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:30.672826 (+ 2684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:30.672831 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:30.673016 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.673168 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.673486 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8479,"mutex_wait_us":87,"spinlock_wait_cycles":20352,"thread_start_us":8206,"threads_started":1}
I20260806 19:28:30.674109 27428 ts_manager.cc:194] Registered new tserver with Master: c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689)
I20260806 19:28:30.674353 28408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.629965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:52479 (local address 127.17.18.126:37961)
0806 19:28:30.630689 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.630696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.638990 (+ 8294us) server_negotiation.cc:407] Connection header received
0806 19:28:30.641155 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.641161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.641267 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.641649 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.646082 (+ 4433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.647260 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.650519 (+ 3259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.651208 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.651360 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.663445 (+ 12085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.663453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.663457 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.663503 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.667146 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.668513 (+ 1367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.668519 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.668522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.668686 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.670268 (+ 1582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.670273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.670276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.670747 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.670903 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.673711 (+ 2808us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.673973 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":531,"threads_started":1}
I20260806 19:28:30.675264 28401 heartbeater.cc:347] Connected to a master server at 127.17.18.126:37961
I20260806 19:28:30.675405 28401 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:30.675542 27721 ts_manager.cc:194] Registered new tserver with Master: c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689)
I20260806 19:28:30.675849 28401 heartbeater.cc:511] Master 127.17.18.126:37961 requested a full tablet report, sending...
I20260806 19:28:30.677012 26551 ts_manager.cc:194] Re-registered known tserver with Master: c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689)
I20260806 19:28:30.678233 26551 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:52479
I20260806 19:28:30.682931 28424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.654118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44746 (local address 127.17.18.124:36899)
0806 19:28:30.655907 (+ 1789us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.655913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.655933 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:28:30.655996 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.656001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.656145 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.659813 (+ 3668us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.660099 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.661411 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.663350 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.664101 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.664188 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.675254 (+ 11066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.675267 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.675272 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.675323 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.679468 (+ 4145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.680496 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.680503 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.680507 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.680680 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.681208 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.681214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.681218 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.681567 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.681833 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.682203 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.682539 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1650,"thread_start_us":1501,"threads_started":1}
I20260806 19:28:30.694226 28423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.651638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41750 (local address 127.17.18.126:37961)
0806 19:28:30.660539 (+ 8901us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.660546 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.660571 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:28:30.665221 (+ 4650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.665227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.665311 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.665597 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.676804 (+ 11207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.678097 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.681228 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.682053 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.682189 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.687658 (+ 5469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.687663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.687666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.687725 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.690610 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.691561 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.691567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.691571 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.691768 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.692261 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.692265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.692267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.692665 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.692955 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.693558 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.693821 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8743,"thread_start_us":9362,"threads_started":1}
I20260806 19:28:30.694243 28426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.655351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46380 (local address 127.17.18.125:42045)
0806 19:28:30.661591 (+ 6240us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.661597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.662274 (+ 677us) server_negotiation.cc:407] Connection header received
0806 19:28:30.662432 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.662438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.662526 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.662675 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:30.677819 (+ 15144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.679510 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.682405 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.683116 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.683240 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.687637 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:30.687652 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:30.687656 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:30.687695 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:30.690494 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.691561 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.691567 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.691571 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.691755 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:30.692373 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:30.692378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:30.692382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:30.692740 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:30.692964 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.693553 (+ 589us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.693821 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6089,"thread_start_us":7130,"threads_started":1}
I20260806 19:28:30.699039 26551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41750:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:30.706296 26551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:30.753625 28445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.727426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45657 (local address 127.0.0.1:45292)
0806 19:28:30.728077 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.728092 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.728267 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.739704 (+ 11437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.739709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.739735 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:30.740187 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.740200 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.743446 (+ 3246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.743451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.749284 (+ 5833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.749301 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.751778 (+ 2477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.751787 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.752059 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.752103 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.752206 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.752361 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":46,"thread_start_us":487,"threads_started":1}
I20260806 19:28:30.754314 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.727629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.17.18.66:45657)
0806 19:28:30.737803 (+ 10174us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.737812 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.737839 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:28:30.737943 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.737949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.738184 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.740437 (+ 2253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:30.740707 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.743083 (+ 2376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.749570 (+ 6487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.751279 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.751481 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.751721 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.753574 (+ 1853us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.753824 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10018,"thread_start_us":9892,"threads_started":1}
I20260806 19:28:30.756210 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.732342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36840 (local address 127.17.18.65:36143)
0806 19:28:30.739939 (+ 7597us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.739948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.741764 (+ 1816us) server_negotiation.cc:407] Connection header received
0806 19:28:30.741973 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.741981 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.742308 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.743382 (+ 1074us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:30.746051 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.748093 (+ 2042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.751996 (+ 3903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.754566 (+ 2570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.754755 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.755018 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.755437 (+ 419us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.755696 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7352,"thread_start_us":7543,"threads_started":1}
I20260806 19:28:30.756273 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.727918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:36143 (local address 127.0.0.1:36840)
0806 19:28:30.741288 (+ 13370us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.741310 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.741564 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.743074 (+ 1510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.743078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.743109 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:30.745611 (+ 2502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.745629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.748319 (+ 2690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.748325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.751788 (+ 3463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.751803 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.754924 (+ 3121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.754934 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.755226 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.755253 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.755334 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.755479 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13092,"mutex_wait_us":114,"thread_start_us":14090,"threads_started":1}
I20260806 19:28:30.757180 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.726371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:33689 (local address 127.0.0.1:56470)
0806 19:28:30.727656 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:30.727674 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:30.738320 (+ 10646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:30.739355 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:30.739361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:30.739397 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:30.739963 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.739981 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.742882 (+ 2901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.742888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.750196 (+ 7308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:30.750213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.755790 (+ 5577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.755800 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:30.756010 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.756045 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:28:30.756149 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 19:28:30.756296 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"mutex_wait_us":51,"thread_start_us":1007,"threads_started":1}
I20260806 19:28:30.759094 28108 tablet_service.cc:1467] Processing CreateTablet for tablet 2341d091d12d4126b37560a87b6563a4 (DEFAULT_TABLE table=test-table [id=8ced54469c4c4318a4791bfc79eab219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:30.760555 28108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2341d091d12d4126b37560a87b6563a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:30.761233 27882 tablet_service.cc:1467] Processing CreateTablet for tablet 2341d091d12d4126b37560a87b6563a4 (DEFAULT_TABLE table=test-table [id=8ced54469c4c4318a4791bfc79eab219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:30.762972 27882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2341d091d12d4126b37560a87b6563a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:30.764268 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:30.726700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56470 (local address 127.17.18.67:33689)
0806 19:28:30.734056 (+ 7356us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:30.734068 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:30.734125 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:28:30.738581 (+ 4456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:30.738590 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:30.738848 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:30.739375 (+ 527us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:30.740289 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.742635 (+ 2346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.751842 (+ 9207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:30.754477 (+ 2635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:30.754670 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:30.754942 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:30.763242 (+ 8300us) server_negotiation.cc:299] Negotiation successful
0806 19:28:30.763555 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":289,"threads_started":1}
I20260806 19:28:30.770059 28312 tablet_service.cc:1467] Processing CreateTablet for tablet 2341d091d12d4126b37560a87b6563a4 (DEFAULT_TABLE table=test-table [id=8ced54469c4c4318a4791bfc79eab219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:30.772236 28312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2341d091d12d4126b37560a87b6563a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:30.786119 28450 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Bootstrap starting.
I20260806 19:28:30.788362 28452 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Bootstrap starting.
I20260806 19:28:30.793598 28450 tablet_bootstrap.cc:654] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:30.795531 28452 tablet_bootstrap.cc:654] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:30.796645 28450 log.cc:824] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:30.797626 28453 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Bootstrap starting.
I20260806 19:28:30.801057 28452 log.cc:824] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:30.804085 28453 tablet_bootstrap.cc:654] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:30.806124 28450 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: No bootstrap required, opened a new log
I20260806 19:28:30.806141 28452 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: No bootstrap required, opened a new log
I20260806 19:28:30.806474 28453 log.cc:824] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:30.806608 28450 ts_tablet_manager.cc:1397] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.008s
I20260806 19:28:30.806650 28452 ts_tablet_manager.cc:1397] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.013s
I20260806 19:28:30.812170 28453 tablet_bootstrap.cc:492] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: No bootstrap required, opened a new log
I20260806 19:28:30.812574 28453 ts_tablet_manager.cc:1397] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260806 19:28:30.825026 28450 raft_consensus.cc:348] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.825079 28452 raft_consensus.cc:348] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.825829 28452 raft_consensus.cc:374] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:30.825845 28450 raft_consensus.cc:374] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:30.826040 28450 raft_consensus.cc:729] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5459b6162100402e97bbecb5497470bc, State: Initialized, Role: FOLLOWER
I20260806 19:28:30.826049 28452 raft_consensus.cc:729] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2875509ec9d646808d2b9ff6aca12c3e, State: Initialized, Role: FOLLOWER
I20260806 19:28:30.826534 28453 raft_consensus.cc:348] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.827214 28453 raft_consensus.cc:374] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:30.826900 28452 consensus_queue.cc:260] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.826967 28450 consensus_queue.cc:260] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.827410 28453 raft_consensus.cc:729] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00f151cd42040c38c43f5dbeffaa504, State: Initialized, Role: FOLLOWER
I20260806 19:28:30.828217 28453 consensus_queue.cc:260] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:30.830935 28450 ts_tablet_manager.cc:1428] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Time spent starting tablet: real 0.024s user 0.015s sys 0.009s
I20260806 19:28:30.834865 28401 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
I20260806 19:28:30.836470 28453 ts_tablet_manager.cc:1428] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Time spent starting tablet: real 0.024s user 0.010s sys 0.013s
I20260806 19:28:30.838486 28192 heartbeater.cc:503] Master 127.17.18.126:37961 was elected leader, sending a full tablet report...
I20260806 19:28:30.840387 28452 ts_tablet_manager.cc:1428] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Time spent starting tablet: real 0.034s user 0.013s sys 0.016s
W20260806 19:28:30.878901 28404 tablet.cc:2369] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:28:30.940099 27999 tablet.cc:2369] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:28:30.998657 28197 tablet.cc:2369] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:31.116097 28459 raft_consensus.cc:482] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:31.116732 28459 raft_consensus.cc:504] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:31.118798 28459 leader_election.cc:288] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689), 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
I20260806 19:28:31.130503 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.119369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:48745 (local address 127.17.18.65:36143)
0806 19:28:31.119654 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.119659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.120761 (+ 1102us) server_negotiation.cc:407] Connection header received
0806 19:28:31.121100 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.121106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.121195 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.121297 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:31.122747 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.123831 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.127467 (+ 3636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.129032 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.129248 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.129344 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.129994 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.130158 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 19:28:31.130914 28462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.119123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:36143 (local address 127.17.18.66:48745)
0806 19:28:31.120608 (+ 1485us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:31.120632 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:31.120833 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:31.121428 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:31.121432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:31.121458 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:31.122540 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:31.122555 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.124021 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.124027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:31.127244 (+ 3217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:31.127262 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.129467 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.129475 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:31.129719 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.129758 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 19:28:31.129965 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 19:28:31.130138 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"thread_start_us":854,"threads_started":1}
I20260806 19:28:31.131656 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.119215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:41753 (local address 127.17.18.67:33689)
0806 19:28:31.119424 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.119431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.121313 (+ 1882us) server_negotiation.cc:407] Connection header received
0806 19:28:31.121628 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.121634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.121740 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.121848 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:31.123482 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.124628 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.128489 (+ 3861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.130115 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.130325 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.130387 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.131304 (+ 917us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.131444 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 19:28:31.132076 28464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.119639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:33689 (local address 127.17.18.66:41753)
0806 19:28:31.121188 (+ 1549us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:31.121207 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:31.121413 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:31.121888 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:31.121898 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:31.121927 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:31.123193 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:31.123207 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.124820 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.124826 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:31.128298 (+ 3472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:31.128316 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.130861 (+ 2545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.130871 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:31.131109 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.131143 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:28:31.131233 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 19:28:31.131381 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1301,"thread_start_us":972,"threads_started":1}
I20260806 19:28:31.132616 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2341d091d12d4126b37560a87b6563a4" candidate_uuid: "2875509ec9d646808d2b9ff6aca12c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5459b6162100402e97bbecb5497470bc" is_pre_election: true
I20260806 19:28:31.133633 27913 raft_consensus.cc:2454] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2875509ec9d646808d2b9ff6aca12c3e in term 0.
I20260806 19:28:31.133780 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2341d091d12d4126b37560a87b6563a4" candidate_uuid: "2875509ec9d646808d2b9ff6aca12c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f151cd42040c38c43f5dbeffaa504" is_pre_election: true
I20260806 19:28:31.134640 28338 raft_consensus.cc:2454] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2875509ec9d646808d2b9ff6aca12c3e in term 0.
I20260806 19:28:31.134821 28037 leader_election.cc:302] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2875509ec9d646808d2b9ff6aca12c3e, 5459b6162100402e97bbecb5497470bc; no voters:
I20260806 19:28:31.135473 28459 raft_consensus.cc:2781] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:31.135759 28459 raft_consensus.cc:482] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:31.135944 28459 raft_consensus.cc:3037] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:31.139925 28459 raft_consensus.cc:504] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:31.140771 28459 leader_election.cc:288] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [CANDIDATE]: Term 1 election: Requested vote from peers c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689), 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143)
I20260806 19:28:31.141577 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2341d091d12d4126b37560a87b6563a4" candidate_uuid: "2875509ec9d646808d2b9ff6aca12c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f151cd42040c38c43f5dbeffaa504"
I20260806 19:28:31.141614 27913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2341d091d12d4126b37560a87b6563a4" candidate_uuid: "2875509ec9d646808d2b9ff6aca12c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5459b6162100402e97bbecb5497470bc"
I20260806 19:28:31.141929 28338 raft_consensus.cc:3037] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:31.141949 27913 raft_consensus.cc:3037] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:31.146370 28338 raft_consensus.cc:2454] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2875509ec9d646808d2b9ff6aca12c3e in term 1.
I20260806 19:28:31.146461 27913 raft_consensus.cc:2454] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2875509ec9d646808d2b9ff6aca12c3e in term 1.
I20260806 19:28:31.147257 28037 leader_election.cc:302] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2875509ec9d646808d2b9ff6aca12c3e, 5459b6162100402e97bbecb5497470bc, c00f151cd42040c38c43f5dbeffaa504; no voters:
I20260806 19:28:31.147804 28459 raft_consensus.cc:2781] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:31.148815 28459 raft_consensus.cc:686] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 1 LEADER]: Becoming Leader. State: Replica: 2875509ec9d646808d2b9ff6aca12c3e, State: Running, Role: LEADER
I20260806 19:28:31.149711 28459 consensus_queue.cc:237] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } }
I20260806 19:28:31.156047 26550 catalog_manager.cc:5495] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66). New cstate: current_term: 1 leader_uuid: "2875509ec9d646808d2b9ff6aca12c3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } health_report { overall_health: HEALTHY } } }
I20260806 19:28:31.218910 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.212950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45298 (local address 127.17.18.66:45657)
0806 19:28:31.213225 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.213232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.213500 (+ 268us) server_negotiation.cc:407] Connection header received
0806 19:28:31.213757 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.213761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.213860 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.214009 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:31.214440 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.215196 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.216554 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.216979 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.217099 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.217718 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:31.218280 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:31.218441 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.218527 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.218622 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 19:28:31.231052 28338 raft_consensus.cc:1261] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Refusing update from remote peer 2875509ec9d646808d2b9ff6aca12c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:31.231081 27913 raft_consensus.cc:1261] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Refusing update from remote peer 2875509ec9d646808d2b9ff6aca12c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:31.232227 28459 consensus_queue.cc:1035] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:31.232671 28465 consensus_queue.cc:1035] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:31.251384 28472 mvcc.cc:205] Tried to move back new op lower bound from 7315638317987782656 to 7315638317673955328. Current Snapshot: MvccSnapshot[applied={T|T < 7315638317987782656}]
I20260806 19:28:31.278348 26550 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:31.278772 26550 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41750:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:31.286286 26550 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b824c1f3834147f2833ca79b591ca786: Sending DeleteTablet for 3 replicas of tablet 2341d091d12d4126b37560a87b6563a4
I20260806 19:28:31.288766 28312 tablet_service.cc:1514] Processing DeleteTablet for tablet 2341d091d12d4126b37560a87b6563a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:31 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:56470
I20260806 19:28:31.288874 27882 tablet_service.cc:1514] Processing DeleteTablet for tablet 2341d091d12d4126b37560a87b6563a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:31 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:36840
I20260806 19:28:31.290483 28108 tablet_service.cc:1514] Processing DeleteTablet for tablet 2341d091d12d4126b37560a87b6563a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:31 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:45292
I20260806 19:28:31.291060 28485 tablet_replica.cc:330] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: stopping tablet replica
I20260806 19:28:31.291771 28485 raft_consensus.cc:2229] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:31.299348 28485 raft_consensus.cc:2258] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:31.304982 28485 ts_tablet_manager.cc:1905] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:31.314504 28486 tablet_replica.cc:330] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: stopping tablet replica
I20260806 19:28:31.315181 28486 raft_consensus.cc:2229] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:31.316246 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 26504
I20260806 19:28:31.316329 28486 raft_consensus.cc:2258] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:31.317625 26591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:31.318840 28486 ts_tablet_manager.cc:1905] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:31.323089 28485 ts_tablet_manager.cc:1918] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:31.324505 28485 log.cc:1196] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/2341d091d12d4126b37560a87b6563a4
I20260806 19:28:31.325773 28485 ts_tablet_manager.cc:1939] T 2341d091d12d4126b37560a87b6563a4 P c00f151cd42040c38c43f5dbeffaa504: Deleting consensus metadata
I20260806 19:28:31.328999 28487 tablet_replica.cc:330] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: stopping tablet replica
I20260806 19:28:31.329640 28487 raft_consensus.cc:2229] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:31.330389 28486 ts_tablet_manager.cc:1918] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:31.330752 28486 log.cc:1196] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/2341d091d12d4126b37560a87b6563a4
I20260806 19:28:31.330751 28487 raft_consensus.cc:2258] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:31.332422 28486 ts_tablet_manager.cc:1939] T 2341d091d12d4126b37560a87b6563a4 P 5459b6162100402e97bbecb5497470bc: Deleting consensus metadata
I20260806 19:28:31.334640 26533 catalog_manager.cc:4841] TS 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143): tablet 2341d091d12d4126b37560a87b6563a4 (table test-table [id=8ced54469c4c4318a4791bfc79eab219]) successfully deleted
I20260806 19:28:31.337327 28487 ts_tablet_manager.cc:1905] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:31.358588 28487 ts_tablet_manager.cc:1918] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:31.359026 28487 log.cc:1196] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/2341d091d12d4126b37560a87b6563a4
I20260806 19:28:31.365684 28487 ts_tablet_manager.cc:1939] T 2341d091d12d4126b37560a87b6563a4 P 2875509ec9d646808d2b9ff6aca12c3e: Deleting consensus metadata
I20260806 19:28:31.369966 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.293773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46382 (local address 127.17.18.125:42045)
0806 19:28:31.313088 (+ 19315us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.313092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.314326 (+ 1234us) server_negotiation.cc:407] Connection header received
0806 19:28:31.314754 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.314761 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.314876 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.325774 (+ 10898us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:31.330580 (+ 4806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.332376 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.335611 (+ 3235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.336584 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.336780 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.343530 (+ 6750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:31.343540 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:31.343545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:31.343604 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:31.355190 (+ 11586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.356712 (+ 1522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.356720 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.356723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.356973 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.357638 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.357644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.357647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.358288 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:31.366992 (+ 8704us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.367229 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.367575 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19127,"thread_start_us":18952,"threads_started":1}
I20260806 19:28:31.390013 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.315131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.17.18.124:36899)
0806 19:28:31.324205 (+ 9074us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.324213 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.360019 (+ 35806us) server_negotiation.cc:407] Connection header received
0806 19:28:31.360271 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.360278 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.360434 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.360539 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:31.363876 (+ 3337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.365718 (+ 1842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.371310 (+ 5592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.372181 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.372297 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.378824 (+ 6527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:31.378833 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:31.378838 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:31.378892 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:31.385195 (+ 6303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.386552 (+ 1357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.386559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.386563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.386830 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.387417 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.387423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.387427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.388097 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:31.388469 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.389010 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.389367 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8847,"thread_start_us":8658,"threads_started":1}
I20260806 19:28:31.487382 26530 catalog_manager.cc:4841] TS 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657): tablet 2341d091d12d4126b37560a87b6563a4 (table test-table [id=8ced54469c4c4318a4791bfc79eab219]) successfully deleted
I20260806 19:28:31.488583 26528 catalog_manager.cc:4841] TS c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689): tablet 2341d091d12d4126b37560a87b6563a4 (table test-table [id=8ced54469c4c4318a4791bfc79eab219]) successfully deleted
I20260806 19:28:31.489131 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 26504
I20260806 19:28:31.546816 28490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.523653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44762 (local address 127.17.18.124:36899)
0806 19:28:31.524064 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.524070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.531236 (+ 7166us) server_negotiation.cc:407] Connection header received
0806 19:28:31.531440 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.531446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.531543 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.531657 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:31.534272 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.535026 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.536517 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.536971 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.537094 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.540547 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:31.540553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:31.540556 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:31.540601 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:31.543839 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.544692 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.544699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.544701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.544845 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.545295 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.545299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.545302 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.545683 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:31.545935 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.546315 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.546545 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277}
I20260806 19:28:31.556758 28489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:31.523656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46388 (local address 127.17.18.125:42045)
0806 19:28:31.523897 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:31.523904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:31.532675 (+ 8771us) server_negotiation.cc:407] Connection header received
0806 19:28:31.532925 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:31.532933 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:31.533048 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:31.533178 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:31.538203 (+ 5025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.539302 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.542481 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:31.543146 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:31.543300 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:31.549279 (+ 5979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:31.549285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:31.549288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:31.549329 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:31.552437 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.554068 (+ 1631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.554074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.554077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.554344 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:31.555121 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:31.555126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:31.555128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:31.555446 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:31.555643 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:31.556299 (+ 656us) server_negotiation.cc:299] Negotiation successful
0806 19:28:31.556509 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:28:32.261070 28504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.260177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:39075)
0806 19:28:32.260721 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.260857 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":254,"threads_started":1}
W20260806 19:28:32.261688 27987 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:37961 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.265326 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.264532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:50595)
0806 19:28:32.265027 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.265154 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":285,"threads_started":1}
W20260806 19:28:32.265769 28401 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:37961 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.269296 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.268363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:48041)
0806 19:28:32.268897 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.269080 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":286,"threads_started":1}
W20260806 19:28:32.269722 28192 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:37961 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.787454 28509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b824c1f3834147f2833ca79b591ca786)
I20260806 19:28:32.787865 28510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b824c1f3834147f2833ca79b591ca786)
I20260806 19:28:32.787851 28509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:32.788161 28510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:32.789351 28509 leader_election.cc:288] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 88db63cf13d045afa40beb78869712aa (127.17.18.125:42045)
I20260806 19:28:32.795562 28510 leader_election.cc:288] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124:36899)
I20260806 19:28:32.802850 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.789602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42124)
0806 19:28:32.802307 (+ 12705us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.802537 (+ 230us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12587,"threads_started":1}
I20260806 19:28:32.809204 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.789973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42132)
0806 19:28:32.808506 (+ 18533us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.808811 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18376,"thread_start_us":12773,"threads_started":1}
W20260806 19:28:32.810477 27411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.811189 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.789757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:42045 (local address 127.0.0.1:46398)
0806 19:28:32.803133 (+ 13376us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.803156 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:32.803344 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:32.803909 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:32.803914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:32.803936 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:32.804234 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:32.804248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.806164 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.806181 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:32.808437 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:32.808460 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.810307 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.810313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:32.810514 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:32.810548 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:28:32.810658 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 19:28:32.810824 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13286,"thread_start_us":12270,"threads_started":1}
I20260806 19:28:32.811259 28521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.790062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46398 (local address 127.17.18.125:42045)
0806 19:28:32.803205 (+ 13143us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:32.803211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:32.803462 (+ 251us) server_negotiation.cc:407] Connection header received
0806 19:28:32.803540 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:32.803545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:32.803610 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:32.803696 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:32.804447 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.805892 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.808646 (+ 2754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.809974 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.810085 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:32.810188 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:32.810717 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 19:28:32.810874 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13013,"thread_start_us":17976,"threads_started":1}
I20260806 19:28:32.811872 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.789779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:36899 (local address 127.0.0.1:44770)
0806 19:28:32.803424 (+ 13645us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.803450 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:32.803562 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:32.804133 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:32.804138 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:32.804167 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:32.804504 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:32.804520 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.806097 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.806102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:32.808469 (+ 2367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:32.808490 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.810356 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.810362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:32.810543 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:32.810577 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:28:32.811232 (+ 655us) client_negotiation.cc:240] Negotiation successful
0806 19:28:32.811513 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13545,"thread_start_us":18034,"threads_started":1}
W20260806 19:28:32.811764 27703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.811192 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.789881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.17.18.124:36899)
0806 19:28:32.801782 (+ 11901us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:32.801790 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:32.803664 (+ 1874us) server_negotiation.cc:407] Connection header received
0806 19:28:32.803740 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:32.803744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:32.803808 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:32.803901 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:32.804722 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.805892 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.808647 (+ 2755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:32.809944 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:32.810064 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:32.810183 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:32.810733 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 19:28:32.810860 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11714,"thread_start_us":11938,"threads_started":1}
I20260806 19:28:32.812493 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d0931b1d6d74172bc7ab943861399a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88db63cf13d045afa40beb78869712aa" is_pre_election: true
I20260806 19:28:32.812932 27446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0931b1d6d74172bc7ab943861399a6 in term 1.
I20260806 19:28:32.813319 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88db63cf13d045afa40beb78869712aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8d0931b1d6d74172bc7ab943861399a6" is_pre_election: true
I20260806 19:28:32.813742 27735 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88db63cf13d045afa40beb78869712aa in term 1.
I20260806 19:28:32.813822 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.813339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42150)
0806 19:28:32.813521 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.813624 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:28:32.813745 27704 leader_election.cc:302] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88db63cf13d045afa40beb78869712aa, 8d0931b1d6d74172bc7ab943861399a6; no voters:
W20260806 19:28:32.814277 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.814392 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.813905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42154)
0806 19:28:32.814122 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.814250 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260806 19:28:32.814416 28509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 19:28:32.814338 27410 leader_election.cc:302] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88db63cf13d045afa40beb78869712aa, 8d0931b1d6d74172bc7ab943861399a6; no voters:
I20260806 19:28:32.814538 28509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b824c1f3834147f2833ca79b591ca786)
I20260806 19:28:32.814640 28509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 1 FOLLOWER]: Advancing to term 2
W20260806 19:28:32.814599 27411 leader_election.cc:334] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.814728 28510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 19:28:32.814838 28510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Starting leader election (detected failure of leader b824c1f3834147f2833ca79b591ca786)
I20260806 19:28:32.814929 28510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 1 FOLLOWER]: Advancing to term 2
I20260806 19:28:32.817121 28510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:32.817127 28509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:32.817867 28510 leader_election.cc:288] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 election: Requested vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 8d0931b1d6d74172bc7ab943861399a6 (127.17.18.124:36899)
I20260806 19:28:32.817935 28509 leader_election.cc:288] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 election: Requested vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 88db63cf13d045afa40beb78869712aa (127.17.18.125:42045)
I20260806 19:28:32.818539 27735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88db63cf13d045afa40beb78869712aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8d0931b1d6d74172bc7ab943861399a6"
I20260806 19:28:32.818729 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.818115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42168)
0806 19:28:32.818360 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.818460 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260806 19:28:32.818814 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.818149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42160)
0806 19:28:32.818389 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.818515 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 19:28:32.818903 27735 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88db63cf13d045afa40beb78869712aa in current term 2: Already voted for candidate 8d0931b1d6d74172bc7ab943861399a6 in this term.
I20260806 19:28:32.818749 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d0931b1d6d74172bc7ab943861399a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88db63cf13d045afa40beb78869712aa"
I20260806 19:28:32.819233 27446 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d0931b1d6d74172bc7ab943861399a6 in current term 2: Already voted for candidate 88db63cf13d045afa40beb78869712aa in this term.
I20260806 19:28:32.820179 28517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.819736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42170)
0806 19:28:32.819942 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.820031 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260806 19:28:32.820202 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:32.819793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:42174)
0806 19:28:32.819952 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:32.820031 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 19:28:32.820436 27411 leader_election.cc:334] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
W20260806 19:28:32.820468 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:32.820551 27411 leader_election.cc:302] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88db63cf13d045afa40beb78869712aa; no voters: 8d0931b1d6d74172bc7ab943861399a6, b824c1f3834147f2833ca79b591ca786
I20260806 19:28:32.820561 27703 leader_election.cc:302] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d0931b1d6d74172bc7ab943861399a6; no voters: 88db63cf13d045afa40beb78869712aa, b824c1f3834147f2833ca79b591ca786
I20260806 19:28:32.820849 28509 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 19:28:32.820842 28510 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 19:28:33.263669 28525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:33.262663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:47259)
0806 19:28:33.263268 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:33.263369 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":302,"threads_started":1}
I20260806 19:28:33.267429 28526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:33.266484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:47589)
0806 19:28:33.267090 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:33.267236 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":371,"threads_started":1}
I20260806 19:28:33.271467 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:33.270388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:49493)
0806 19:28:33.271058 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:33.271218 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":435,"threads_started":1}
I20260806 19:28:34.266222 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.265167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:52395)
0806 19:28:34.265850 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.265965 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":415,"threads_started":1}
I20260806 19:28:34.268996 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.268243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:60507)
0806 19:28:34.268715 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.268810 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":247,"threads_started":1}
I20260806 19:28:34.273173 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.272333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:55671)
0806 19:28:34.272900 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.272990 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":331,"threads_started":1}
I20260806 19:28:34.674224 28532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:34.674479 28532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:34.675233 28532 leader_election.cc:288] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 88db63cf13d045afa40beb78869712aa (127.17.18.125:42045)
I20260806 19:28:34.675892 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d0931b1d6d74172bc7ab943861399a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88db63cf13d045afa40beb78869712aa" is_pre_election: true
I20260806 19:28:34.676146 27446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0931b1d6d74172bc7ab943861399a6 in term 2.
I20260806 19:28:34.676718 27704 leader_election.cc:302] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88db63cf13d045afa40beb78869712aa, 8d0931b1d6d74172bc7ab943861399a6; no voters:
I20260806 19:28:34.676987 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.675481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35338)
0806 19:28:34.676576 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.676750 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":916,"thread_start_us":773,"threads_started":1}
I20260806 19:28:34.677029 28532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 19:28:34.677211 28532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:34.677316 28532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 2 FOLLOWER]: Advancing to term 3
I20260806 19:28:34.678557 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.678147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35342)
0806 19:28:34.678319 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.678404 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 19:28:34.678747 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:34.679811 28532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:34.680403 28532 leader_election.cc:288] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 election: Requested vote from peers b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961), 88db63cf13d045afa40beb78869712aa (127.17.18.125:42045)
I20260806 19:28:34.681003 27446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8d0931b1d6d74172bc7ab943861399a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88db63cf13d045afa40beb78869712aa"
I20260806 19:28:34.681187 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.680640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35348)
0806 19:28:34.680858 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.680977 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 19:28:34.681277 27446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 2 FOLLOWER]: Advancing to term 3
I20260806 19:28:34.683663 27446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d0931b1d6d74172bc7ab943861399a6 in term 3.
I20260806 19:28:34.684237 27704 leader_election.cc:302] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88db63cf13d045afa40beb78869712aa, 8d0931b1d6d74172bc7ab943861399a6; no voters:
I20260806 19:28:34.684796 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.684407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35354)
0806 19:28:34.684585 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.684670 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 19:28:34.684983 27703 leader_election.cc:334] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
I20260806 19:28:34.685050 28532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 19:28:34.685585 28532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [term 3 LEADER]: Becoming Leader. State: Replica: 8d0931b1d6d74172bc7ab943861399a6, State: Running, Role: LEADER
I20260806 19:28:34.685992 28532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } }
I20260806 19:28:34.687750 28536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d0931b1d6d74172bc7ab943861399a6. Latest consensus state: current_term: 3 leader_uuid: "8d0931b1d6d74172bc7ab943861399a6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:34.688191 28536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:34.688951 28539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:34.693490 28539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:34.694489 28539 catalog_manager.cc:1259] Loaded cluster ID: 5dbfebd39ad64c6c97e91694e0f16bfd
I20260806 19:28:34.694581 28539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:34.695974 28539 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:34.697152 28539 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Loaded TSK: 0
I20260806 19:28:34.698248 28539 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:28:34.780997 27721 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:34.788841 27721 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:34.793648 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.793165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35386)
0806 19:28:34.793345 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.793469 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 19:28:34.793751 27446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [term 3 FOLLOWER]: Refusing update from remote peer 8d0931b1d6d74172bc7ab943861399a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260806 19:28:34.794539 28536 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 19:28:34.794760 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.794334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35394)
0806 19:28:34.794506 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.794620 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 19:28:34.794963 27703 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 -> Peer b824c1f3834147f2833ca79b591ca786 (127.17.18.126:37961): Couldn't send request to peer b824c1f3834147f2833ca79b591ca786. Status: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 19:28:34.798467 28542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d0931b1d6d74172bc7ab943861399a6. Latest consensus state: current_term: 3 leader_uuid: "8d0931b1d6d74172bc7ab943861399a6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:34.798763 28542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:34.799716 28532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8d0931b1d6d74172bc7ab943861399a6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:34.800105 28532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6 [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:34.802083 28542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8d0931b1d6d74172bc7ab943861399a6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b824c1f3834147f2833ca79b591ca786" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37961 } } peers { permanent_uuid: "88db63cf13d045afa40beb78869712aa" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 42045 } attrs { promote: false } } peers { permanent_uuid: "8d0931b1d6d74172bc7ab943861399a6" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 36899 } attrs { promote: false } } }
I20260806 19:28:34.802366 28542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88db63cf13d045afa40beb78869712aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:28:34.818437 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.809728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:33689 (local address 127.0.0.1:53276)
0806 19:28:34.809908 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.809931 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:34.810072 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:34.810768 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:34.810775 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:34.810810 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:34.811168 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.811179 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.812973 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.812981 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.815346 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.815373 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.817425 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.817434 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.817682 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.817733 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 19:28:34.817821 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:28:34.818015 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 19:28:34.820598 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.809875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.17.18.67:33689)
0806 19:28:34.810390 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:34.810396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:34.810415 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:28:34.810491 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:34.810496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:34.810571 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:34.811341 (+ 770us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:34.811556 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.812781 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.815681 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.817103 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.819693 (+ 2590us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.819912 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:34.819992 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 19:28:34.820189 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":295,"threads_started":1}
I20260806 19:28:34.821951 28312 tablet_service.cc:1467] Processing CreateTablet for tablet 688654e0347a4c37b8cc56d5146055cf (DEFAULT_TABLE table=test-table [id=088404e69a5f4aafa9fd1542e8bd907c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:34.822559 28312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 688654e0347a4c37b8cc56d5146055cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:34.832429 28555 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Bootstrap starting.
I20260806 19:28:34.834510 28555 tablet_bootstrap.cc:654] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:34.837352 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.810555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54162 (local address 127.17.18.66:45657)
0806 19:28:34.831401 (+ 20846us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:34.831408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:34.831430 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:28:34.831501 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:34.831506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:34.831585 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:34.831693 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:34.832432 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.833480 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.835588 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.836386 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.836511 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.836669 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:34.836908 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 19:28:34.837065 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20705,"thread_start_us":20540,"threads_started":1}
I20260806 19:28:34.837446 28533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.810441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45657 (local address 127.0.0.1:54162)
0806 19:28:34.818795 (+ 8354us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.818822 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:34.818971 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:34.831775 (+ 12804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:34.831783 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:34.831823 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:34.832015 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.832025 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.833626 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.833632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.835411 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.835426 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.836563 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.836570 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.836748 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.836774 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 19:28:34.836859 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 19:28:34.837015 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8207,"mutex_wait_us":51,"thread_start_us":15637,"threads_started":1}
I20260806 19:28:34.837944 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.812196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:36143 (local address 127.0.0.1:56526)
0806 19:28:34.825756 (+ 13560us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.825784 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:34.825977 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:34.830403 (+ 4426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:34.830408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:34.830435 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:34.830777 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.830792 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.832266 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.832271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.835073 (+ 2802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:34.835092 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.836994 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.837001 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:34.837195 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.837242 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 19:28:34.837314 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 19:28:34.837530 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13388,"mutex_wait_us":1,"thread_start_us":17207,"threads_started":1}
I20260806 19:28:34.838971 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.811307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56526 (local address 127.17.18.65:36143)
0806 19:28:34.829843 (+ 18536us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:34.829849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:34.829871 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:28:34.829949 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:34.829955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:34.830039 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:34.830192 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:34.830995 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.832091 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.835322 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:34.836704 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:34.838247 (+ 1543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:34.838374 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:34.838438 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 19:28:34.838603 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18376,"thread_start_us":18546,"threads_started":1}
I20260806 19:28:34.839171 28108 tablet_service.cc:1467] Processing CreateTablet for tablet 688654e0347a4c37b8cc56d5146055cf (DEFAULT_TABLE table=test-table [id=088404e69a5f4aafa9fd1542e8bd907c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:34.839634 28108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 688654e0347a4c37b8cc56d5146055cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:34.841857 27882 tablet_service.cc:1467] Processing CreateTablet for tablet 688654e0347a4c37b8cc56d5146055cf (DEFAULT_TABLE table=test-table [id=088404e69a5f4aafa9fd1542e8bd907c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:34.842322 27882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 688654e0347a4c37b8cc56d5146055cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:34.843237 28555 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: No bootstrap required, opened a new log
I20260806 19:28:34.843403 28555 ts_tablet_manager.cc:1397] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260806 19:28:34.844125 28555 raft_consensus.cc:348] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.844344 28555 raft_consensus.cc:374] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:34.844436 28555 raft_consensus.cc:729] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00f151cd42040c38c43f5dbeffaa504, State: Initialized, Role: FOLLOWER
I20260806 19:28:34.844786 28555 consensus_queue.cc:260] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.845736 28555 ts_tablet_manager.cc:1428] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260806 19:28:34.847071 28558 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Bootstrap starting.
I20260806 19:28:34.849102 28558 tablet_bootstrap.cc:654] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:34.849882 28398 heartbeater.cc:503] Master 127.17.18.124:36899 was elected leader, sending a full tablet report...
I20260806 19:28:34.852218 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.846441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:56851)
0806 19:28:34.850672 (+ 4231us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.850858 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4068,"thread_start_us":3921,"threads_started":1}
I20260806 19:28:34.853322 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.852953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:57893)
0806 19:28:34.853099 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.853187 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 19:28:34.856477 28558 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: No bootstrap required, opened a new log
I20260806 19:28:34.856665 28558 ts_tablet_manager.cc:1397] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260806 19:28:34.855751 28562 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Bootstrap starting.
I20260806 19:28:34.857606 28558 raft_consensus.cc:348] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.857841 28558 raft_consensus.cc:374] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:34.857936 28558 raft_consensus.cc:729] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2875509ec9d646808d2b9ff6aca12c3e, State: Initialized, Role: FOLLOWER
I20260806 19:28:34.858209 28558 consensus_queue.cc:260] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.858700 28562 tablet_bootstrap.cc:654] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:34.859124 28558 ts_tablet_manager.cc:1428] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 19:28:34.861878 28191 heartbeater.cc:503] Master 127.17.18.124:36899 was elected leader, sending a full tablet report...
I20260806 19:28:34.862502 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.859443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:56455)
0806 19:28:34.861955 (+ 2512us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.862201 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2368,"thread_start_us":2158,"threads_started":1}
I20260806 19:28:34.865072 28567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.863872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:42891)
0806 19:28:34.864574 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.864798 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":346,"threads_started":1}
I20260806 19:28:34.866317 28562 tablet_bootstrap.cc:492] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: No bootstrap required, opened a new log
I20260806 19:28:34.866470 28562 ts_tablet_manager.cc:1397] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 19:28:34.867225 28562 raft_consensus.cc:348] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.867424 28562 raft_consensus.cc:374] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:34.867491 28562 raft_consensus.cc:729] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5459b6162100402e97bbecb5497470bc, State: Initialized, Role: FOLLOWER
I20260806 19:28:34.867691 28562 consensus_queue.cc:260] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:34.868423 28562 ts_tablet_manager.cc:1428] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:34.869863 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.868847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:59927)
0806 19:28:34.869483 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.869638 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":281,"threads_started":1}
I20260806 19:28:34.870828 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:34.870437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:33761)
0806 19:28:34.870591 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:34.870685 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 19:28:34.871007 27985 heartbeater.cc:503] Master 127.17.18.124:36899 was elected leader, sending a full tablet report...
I20260806 19:28:35.039588 28568 raft_consensus.cc:482] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:35.039880 28568 raft_consensus.cc:504] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:35.041620 28568 leader_election.cc:288] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689), 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:35.048015 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.042124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:53299 (local address 127.17.18.66:45657)
0806 19:28:35.042319 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.042323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.042575 (+ 252us) server_negotiation.cc:407] Connection header received
0806 19:28:35.042882 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.042887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.042953 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.043033 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:35.043557 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.044314 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.046203 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.047019 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.047207 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.047290 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.047596 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.047743 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 19:28:35.048069 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.041969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45657 (local address 127.17.18.65:53299)
0806 19:28:35.042449 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.042466 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:35.042699 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:35.043081 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:35.043086 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:35.043115 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:35.043407 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:35.043417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.044455 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.044459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:35.046009 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:35.046025 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.047250 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.047257 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:35.047426 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.047453 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 19:28:35.047541 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:28:35.047720 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371}
I20260806 19:28:35.048460 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.042124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:35185 (local address 127.17.18.67:33689)
0806 19:28:35.042359 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.042365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.043097 (+ 732us) server_negotiation.cc:407] Connection header received
0806 19:28:35.043375 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.043379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.043453 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.043534 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:35.044062 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.044801 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.046649 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.047481 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.047653 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.047734 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.048055 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.048204 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 19:28:35.048585 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.042052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:33689 (local address 127.17.18.65:35185)
0806 19:28:35.042963 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.042977 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:35.043215 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:35.043584 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:35.043589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:35.043614 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:35.043908 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:35.043918 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.044956 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.044960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:35.046462 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:35.046477 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.047729 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.047736 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:35.047887 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.047912 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:28:35.047998 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 19:28:35.048157 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"spinlock_wait_cycles":2816,"thread_start_us":550,"threads_started":1}
I20260806 19:28:35.049175 28137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "688654e0347a4c37b8cc56d5146055cf" candidate_uuid: "5459b6162100402e97bbecb5497470bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2875509ec9d646808d2b9ff6aca12c3e" is_pre_election: true
I20260806 19:28:35.049352 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "688654e0347a4c37b8cc56d5146055cf" candidate_uuid: "5459b6162100402e97bbecb5497470bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f151cd42040c38c43f5dbeffaa504" is_pre_election: true
I20260806 19:28:35.049654 28338 raft_consensus.cc:2454] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5459b6162100402e97bbecb5497470bc in term 0.
I20260806 19:28:35.049732 28137 raft_consensus.cc:2454] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5459b6162100402e97bbecb5497470bc in term 0.
I20260806 19:28:35.050357 27821 leader_election.cc:302] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5459b6162100402e97bbecb5497470bc, c00f151cd42040c38c43f5dbeffaa504; no voters:
I20260806 19:28:35.050788 28568 raft_consensus.cc:2781] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:35.050930 28568 raft_consensus.cc:482] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:35.051031 28568 raft_consensus.cc:3037] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:35.053300 28568 raft_consensus.cc:504] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:35.054018 28568 leader_election.cc:288] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [CANDIDATE]: Term 1 election: Requested vote from peers c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689), 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657)
I20260806 19:28:35.054752 28137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "688654e0347a4c37b8cc56d5146055cf" candidate_uuid: "5459b6162100402e97bbecb5497470bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2875509ec9d646808d2b9ff6aca12c3e"
I20260806 19:28:35.054731 28338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "688654e0347a4c37b8cc56d5146055cf" candidate_uuid: "5459b6162100402e97bbecb5497470bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f151cd42040c38c43f5dbeffaa504"
I20260806 19:28:35.054992 28338 raft_consensus.cc:3037] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:35.054992 28137 raft_consensus.cc:3037] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:35.058312 28338 raft_consensus.cc:2454] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5459b6162100402e97bbecb5497470bc in term 1.
I20260806 19:28:35.058312 28137 raft_consensus.cc:2454] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5459b6162100402e97bbecb5497470bc in term 1.
I20260806 19:28:35.058911 27822 leader_election.cc:302] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2875509ec9d646808d2b9ff6aca12c3e, 5459b6162100402e97bbecb5497470bc; no voters:
I20260806 19:28:35.059310 28568 raft_consensus.cc:2781] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:35.059851 28568 raft_consensus.cc:686] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 1 LEADER]: Becoming Leader. State: Replica: 5459b6162100402e97bbecb5497470bc, State: Running, Role: LEADER
I20260806 19:28:35.060321 28568 consensus_queue.cc:237] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } }
I20260806 19:28:35.061070 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.060594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:40933)
0806 19:28:35.060781 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.060887 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 19:28:35.064807 27719 catalog_manager.cc:5495] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5459b6162100402e97bbecb5497470bc (127.17.18.65). New cstate: current_term: 1 leader_uuid: "5459b6162100402e97bbecb5497470bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5459b6162100402e97bbecb5497470bc" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 36143 } health_report { overall_health: HEALTHY } } }
I20260806 19:28:35.086506 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.080851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56530 (local address 127.17.18.65:36143)
0806 19:28:35.081080 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.081086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.081107 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:28:35.081303 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.081308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.081454 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.081642 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:35.082025 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.082803 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.084176 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.084661 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.084775 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.085233 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:35.085884 (+ 651us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:35.086026 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.086136 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.086231 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:28:35.091307 28338 raft_consensus.cc:1261] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Refusing update from remote peer 5459b6162100402e97bbecb5497470bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:35.091747 28137 raft_consensus.cc:1261] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Refusing update from remote peer 5459b6162100402e97bbecb5497470bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:35.092248 28573 consensus_queue.cc:1035] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00f151cd42040c38c43f5dbeffaa504" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:35.092736 28568 consensus_queue.cc:1035] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2875509ec9d646808d2b9ff6aca12c3e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:35.095445 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.094841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:48609)
0806 19:28:35.095095 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.095246 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260806 19:28:35.096655 28567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.096243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:56017)
0806 19:28:35.096413 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.096508 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 19:28:35.103816 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.103284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:38329)
0806 19:28:35.103453 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.103595 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 19:28:35.106717 28567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.103284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.66:42979)
0806 19:28:35.106333 (+ 3049us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.106474 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2902}
I20260806 19:28:35.110222 28579 mvcc.cc:205] Tried to move back new op lower bound from 7315638333805719552 to 7315638333691731968. Current Snapshot: MvccSnapshot[applied={T|T < 7315638333805719552}]
I20260806 19:28:35.111259 28572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.107453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.65:59237)
0806 19:28:35.110939 (+ 3486us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.111072 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3357}
I20260806 19:28:35.113121 28560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.111408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.17.18.67:46949)
0806 19:28:35.111774 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.111885 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260806 19:28:35.128495 27719 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:35.128820 27719 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:35.135264 27719 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8d0931b1d6d74172bc7ab943861399a6: Sending DeleteTablet for 3 replicas of tablet 688654e0347a4c37b8cc56d5146055cf
I20260806 19:28:35.136745 28108 tablet_service.cc:1514] Processing DeleteTablet for tablet 688654e0347a4c37b8cc56d5146055cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:35 UTC) from {username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:54162
I20260806 19:28:35.136749 27882 tablet_service.cc:1514] Processing DeleteTablet for tablet 688654e0347a4c37b8cc56d5146055cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:35 UTC) from {username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:56526
I20260806 19:28:35.137284 28312 tablet_service.cc:1514] Processing DeleteTablet for tablet 688654e0347a4c37b8cc56d5146055cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:35 UTC) from {username='oryx', principal='oryx/127.17.18.124@KRBTEST.COM'} at 127.0.0.1:53276
I20260806 19:28:35.138121 28595 tablet_replica.cc:330] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: stopping tablet replica
I20260806 19:28:35.138350 28595 raft_consensus.cc:2229] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:35.138471 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 27667
I20260806 19:28:35.138696 28595 raft_consensus.cc:2258] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:35.140471 28595 ts_tablet_manager.cc:1905] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:35.141283 28591 tablet_replica.cc:330] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: stopping tablet replica
I20260806 19:28:35.141618 28591 raft_consensus.cc:2229] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:35.142448 28591 raft_consensus.cc:2258] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:35.144501 28591 ts_tablet_manager.cc:1905] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:35.148617 28595 ts_tablet_manager.cc:1918] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:35.148826 28595 log.cc:1196] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/688654e0347a4c37b8cc56d5146055cf
I20260806 19:28:35.149353 28595 ts_tablet_manager.cc:1939] T 688654e0347a4c37b8cc56d5146055cf P c00f151cd42040c38c43f5dbeffaa504: Deleting consensus metadata
I20260806 19:28:35.151032 27699 catalog_manager.cc:4841] TS c00f151cd42040c38c43f5dbeffaa504 (127.17.18.67:33689): tablet 688654e0347a4c37b8cc56d5146055cf (table test-table [id=088404e69a5f4aafa9fd1542e8bd907c]) successfully deleted
I20260806 19:28:35.157811 28591 ts_tablet_manager.cc:1918] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:35.158035 28591 log.cc:1196] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/688654e0347a4c37b8cc56d5146055cf
I20260806 19:28:35.159207 28590 tablet_replica.cc:330] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: stopping tablet replica
I20260806 19:28:35.159417 28590 raft_consensus.cc:2229] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:35.159708 28590 raft_consensus.cc:2258] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:35.160171 28591 ts_tablet_manager.cc:1939] T 688654e0347a4c37b8cc56d5146055cf P 5459b6162100402e97bbecb5497470bc: Deleting consensus metadata
I20260806 19:28:35.161477 28590 ts_tablet_manager.cc:1905] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:35.161556 27704 catalog_manager.cc:4841] TS 5459b6162100402e97bbecb5497470bc (127.17.18.65:36143): tablet 688654e0347a4c37b8cc56d5146055cf (table test-table [id=088404e69a5f4aafa9fd1542e8bd907c]) successfully deleted
I20260806 19:28:35.170215 28590 ts_tablet_manager.cc:1918] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:35.170420 28590 log.cc:1196] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/688654e0347a4c37b8cc56d5146055cf
I20260806 19:28:35.171049 28590 ts_tablet_manager.cc:1939] T 688654e0347a4c37b8cc56d5146055cf P 2875509ec9d646808d2b9ff6aca12c3e: Deleting consensus metadata
I20260806 19:28:35.172511 27702 catalog_manager.cc:4841] TS 2875509ec9d646808d2b9ff6aca12c3e (127.17.18.66:45657): tablet 688654e0347a4c37b8cc56d5146055cf (table test-table [id=088404e69a5f4aafa9fd1542e8bd907c]) successfully deleted
I20260806 19:28:35.173913 28553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.139358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56540 (local address 127.17.18.65:36143)
0806 19:28:35.139571 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.139577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.151996 (+ 12419us) server_negotiation.cc:407] Connection header received
0806 19:28:35.152141 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.152157 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.152285 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.152411 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:35.154539 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.156068 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.158327 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.159056 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.159184 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.163439 (+ 4255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:35.163468 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:35.163494 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:35.163556 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:35.168420 (+ 4864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.169661 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.169674 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.169678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.169961 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.170678 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.170685 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.170689 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.171277 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:35.171792 (+ 515us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.173079 (+ 1287us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.173449 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:28:35.174796 27974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:35.253785 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.253233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35404)
0806 19:28:35.253477 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.253587 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 19:28:35.254979 28550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.254580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37961 (local address 127.0.0.1:35418)
0806 19:28:35.254737 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:35.254840 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:37961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 19:28:35.285982 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 27667
I20260806 19:28:35.312649 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 28010
I20260806 19:28:35.326957 28552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.313482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54178 (local address 127.17.18.66:45657)
0806 19:28:35.313668 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.313675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.313765 (+ 90us) server_negotiation.cc:407] Connection header received
0806 19:28:35.313967 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.313973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.314044 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.314144 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:35.315535 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.316310 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.317657 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.318070 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.318193 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.320982 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:35.321003 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:35.321022 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:35.321070 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:35.323986 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.324732 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.324741 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.324743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.324891 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.325291 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.325295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.325297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.325737 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:35.326053 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.326379 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.326610 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:28:35.327701 28185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:35.464700 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 28010
I20260806 19:28:35.495576 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 28214
I20260806 19:28:35.510100 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:35.496454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53292 (local address 127.17.18.67:33689)
0806 19:28:35.496632 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:35.496637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:35.496673 (+ 36us) server_negotiation.cc:407] Connection header received
0806 19:28:35.496807 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:35.496811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:35.496889 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:35.496972 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:35.498377 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.499141 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.500439 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:35.500860 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:35.500959 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:35.503793 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:35.503811 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:35.503831 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:35.503872 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:35.506903 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.507776 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.507788 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.507790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.507960 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:35.508416 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:35.508420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:35.508422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:35.508861 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:35.509108 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:35.509537 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 19:28:35.509762 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:28:35.510900 28391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:35.607697 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 28214
I20260806 19:28:35.631145 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 27218
I20260806 19:28:35.632366 27470 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:35.761922 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 27218
I20260806 19:28:35.789170 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 27379
I20260806 19:28:35.790443 27761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:35.917695 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 27379
2026-08-06T19:28:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (13296 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:36 dist-test-slave-f0tn krb5kdc[28612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:36 dist-test-slave-f0tn krb5kdc[28612](info): set up 2 sockets
Aug 06 19:28:36 dist-test-slave-f0tn krb5kdc[28612](info): commencing operation
krb5kdc: starting...
W20260806 19:28:37.188349 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.005s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:37 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:37Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab.
Entry for principal oryx/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab.
I20260806 19:28:37.477792 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42297
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab
--principal=oryx/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:42297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:37.837868 28631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:37.838200 28631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:37.838341 28631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:37.845906 28631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:37.846026 28631 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 19:28:37.846073 28631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:37.846170 28631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:37.846251 28631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:37.846342 28631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:37.856701 28631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:42297
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.126.keytab
--principal=oryx/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:37.858222 28631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:37.859704 28631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:37.873063 28639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:37.873041 28643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:37.872991 28637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:37.873354 28631 server_base.cc:1034] running on GCE node
I20260806 19:28:37.874583 28631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:37.876543 28631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:37.877837 28631 hybrid_clock.cc:648] HybridClock initialized: now 1786044517877743 us; error 62 us; skew 500 ppm
I20260806 19:28:37.878268 28631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:37 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044517, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:37.881778 28631 init.cc:377] Logged in from keytab as oryx/127.17.18.126@KRBTEST.COM (short username oryx)
I20260806 19:28:37.883680 28631 webserver.cc:460] Webserver started at http://127.17.18.126:33005/ using document root <none> and password file <none>
I20260806 19:28:37.884512 28631 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:37.884616 28631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:37.885087 28631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:37.888736 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "55451ca2740e4892ae1a3c207f2031bf"
format_stamp: "Formatted at 2026-08-06 19:28:37 on dist-test-slave-f0tn"
server_key: "528c55af85a8002d3930257a939d4e4d"
server_key_iv: "e8e474b22a806667d0fc02fa141bf8e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:37.889827 28631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "55451ca2740e4892ae1a3c207f2031bf"
format_stamp: "Formatted at 2026-08-06 19:28:37 on dist-test-slave-f0tn"
server_key: "528c55af85a8002d3930257a939d4e4d"
server_key_iv: "e8e474b22a806667d0fc02fa141bf8e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:37.896102 28631 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:37.900506 28653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:37.902307 28631 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 19:28:37.902522 28631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "55451ca2740e4892ae1a3c207f2031bf"
format_stamp: "Formatted at 2026-08-06 19:28:37 on dist-test-slave-f0tn"
server_key: "528c55af85a8002d3930257a939d4e4d"
server_key_iv: "e8e474b22a806667d0fc02fa141bf8e2"
server_key_version: "encryptionkey@0"
I20260806 19:28:37.902776 28631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:37.921337 28631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:37.926097 28631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:37.926396 28631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:37.949571 28631 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:42297
I20260806 19:28:37.949592 28746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:42297 every 8 connection(s)
I20260806 19:28:37.951020 28631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:37.955123 28747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:37.957739 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 28631
I20260806 19:28:37.957968 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:37.958606 17481 external_mini_cluster.cc:1428] Setting key 78a67f85af822a07131a0f50b9b76467
I20260806 19:28:37.967693 28747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Bootstrap starting.
I20260806 19:28:37.971850 28747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:37.973325 28747 log.cc:824] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:28:37 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:37.976776 28747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: No bootstrap required, opened a new log
I20260806 19:28:37.983387 28764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:37.960642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52638 (local address 127.17.18.126:42297)
0806 19:28:37.961509 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:37.961522 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:37.961570 (+ 48us) server_negotiation.cc:407] Connection header received
0806 19:28:37.963408 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:37.963439 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:37.963877 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:37.964251 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:37.966154 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:37.967652 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:37.969534 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:37.970300 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:37.970459 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:37.975525 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:37.975534 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:37.975553 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:37.975595 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:37.978817 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:37.979768 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:37.979779 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:37.979786 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:37.979989 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:37.980388 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:37.980391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:37.980393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:37.980989 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:37.981256 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:37.981771 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 19:28:37.982237 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":365,"threads_started":1}
I20260806 19:28:37.986259 28747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } }
I20260806 19:28:37.986716 28747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:37.986832 28747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55451ca2740e4892ae1a3c207f2031bf, State: Initialized, Role: FOLLOWER
I20260806 19:28:37.987396 28747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } }
I20260806 19:28:37.987668 28747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:37.987807 28747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:37.987946 28747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:37.990509 28747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } }
I20260806 19:28:37.991040 28747 leader_election.cc:302] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55451ca2740e4892ae1a3c207f2031bf; no voters:
I20260806 19:28:37.991627 28747 leader_election.cc:288] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:37.991773 28769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:37.992503 28769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [term 1 LEADER]: Becoming Leader. State: Replica: 55451ca2740e4892ae1a3c207f2031bf, State: Running, Role: LEADER
I20260806 19:28:37.993105 28769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } }
I20260806 19:28:37.993908 28747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:37.996150 28770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55451ca2740e4892ae1a3c207f2031bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } } }
I20260806 19:28:37.996176 28771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55451ca2740e4892ae1a3c207f2031bf. Latest consensus state: current_term: 1 leader_uuid: "55451ca2740e4892ae1a3c207f2031bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55451ca2740e4892ae1a3c207f2031bf" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42297 } } }
I20260806 19:28:37.996623 28770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:37.996747 28771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:37.997555 28776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:38.003661 28776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:38.014554 28776 catalog_manager.cc:1347] Generated new cluster ID: 5f750c3b66f84aa2ad516b30b3304b31
I20260806 19:28:38.014695 28776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:38.030999 28776 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:38.032682 28776 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:38.041535 28776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Generated new TSK 0
I20260806 19:28:38.042788 28776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
I20260806 19:28:38.118685 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42297
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:38.487661 28810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:38.488322 28810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:38.488562 28810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:38.498546 28810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:38.498682 28810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:38.498800 28810 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:28:38.498885 28810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:38.509720 28810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:38.511276 28810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:38.513366 28810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:38.529420 28816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:38.529358 28817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:38.529331 28819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:38.530349 28810 server_base.cc:1034] running on GCE node
I20260806 19:28:38.531040 28810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:38.532119 28810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:38.533432 28810 hybrid_clock.cc:648] HybridClock initialized: now 1786044518533296 us; error 51 us; skew 500 ppm
I20260806 19:28:38.533789 28810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:38 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044518, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:38.537297 28810 init.cc:377] Logged in from keytab as oryx/127.17.18.65@KRBTEST.COM (short username oryx)
I20260806 19:28:38.538949 28810 webserver.cc:460] Webserver started at http://127.17.18.65:38295/ using document root <none> and password file <none>
I20260806 19:28:38.539817 28810 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:38.539939 28810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:38.540272 28810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:38.543481 28810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "cc95c663c01745d9838f93b5f6370209"
format_stamp: "Formatted at 2026-08-06 19:28:38 on dist-test-slave-f0tn"
server_key: "14372d6aad4b0bdd7780189f5961234d"
server_key_iv: "c4593be1f1cd6fbddbf84c66b81d1bc2"
server_key_version: "encryptionkey@0"
I20260806 19:28:38.544304 28810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "cc95c663c01745d9838f93b5f6370209"
format_stamp: "Formatted at 2026-08-06 19:28:38 on dist-test-slave-f0tn"
server_key: "14372d6aad4b0bdd7780189f5961234d"
server_key_iv: "c4593be1f1cd6fbddbf84c66b81d1bc2"
server_key_version: "encryptionkey@0"
I20260806 19:28:38.550269 28810 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:28:38.554452 28829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:38.555959 28810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 19:28:38.556160 28810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "cc95c663c01745d9838f93b5f6370209"
format_stamp: "Formatted at 2026-08-06 19:28:38 on dist-test-slave-f0tn"
server_key: "14372d6aad4b0bdd7780189f5961234d"
server_key_iv: "c4593be1f1cd6fbddbf84c66b81d1bc2"
server_key_version: "encryptionkey@0"
I20260806 19:28:38.556409 28810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:38.577490 28810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:38.582333 28810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:38.582635 28810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:38.585813 28810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:38.585932 28810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:38.586086 28810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:38.586220 28810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:28:38 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044518, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:38.609539 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:38.586431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:36737 (local address 127.17.18.126:42297)
0806 19:28:38.587249 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:38.587256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:38.588220 (+ 964us) server_negotiation.cc:407] Connection header received
0806 19:28:38.590500 (+ 2280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:38.590506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:38.590596 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:38.590693 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:38.593067 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.594124 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.595896 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.596347 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.596470 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:38.601492 (+ 5022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:38.601501 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:38.601505 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:38.601554 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:38.605243 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:38.606464 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:38.606469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:38.606471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:38.606618 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:38.607264 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:38.607271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:38.607275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:38.607744 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:38.607914 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:38.608788 (+ 874us) server_negotiation.cc:299] Negotiation successful
0806 19:28:38.609083 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":590,"threads_started":1}
I20260806 19:28:38.610576 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:38.587134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.65:36737)
0806 19:28:38.588016 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:38.588062 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:38.590131 (+ 2069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:38.590994 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:38.591004 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:38.591835 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:38.592805 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:38.592835 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.594305 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.594309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:38.595741 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:38.595756 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.596626 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.596635 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:38.596843 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:38.597623 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:38.597654 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:38.601080 (+ 3426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:38.605459 (+ 4379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:38.605476 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:38.605497 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:38.606252 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:38.606752 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:38.606756 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:38.606758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:38.607091 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:38.607908 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:38.607915 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:38.608373 (+ 458us) client_negotiation.cc:769] Sending connection context
0806 19:28:38.608620 (+ 247us) client_negotiation.cc:240] Negotiation successful
0806 19:28:38.609098 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":368,"threads_started":1}
I20260806 19:28:38.648509 28842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:38.621481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48313 (local address 127.17.18.126:42297)
0806 19:28:38.622160 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:38.622166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:38.624070 (+ 1904us) server_negotiation.cc:407] Connection header received
0806 19:28:38.624316 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:38.624323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:38.624419 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:38.624543 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:38.627833 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.629440 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.633265 (+ 3825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.634463 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.634597 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:38.639237 (+ 4640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:38.639247 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:38.639252 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:38.639299 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:38.643679 (+ 4380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:38.644985 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:38.644992 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:38.644995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:38.645299 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:38.645914 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:38.645920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:38.645922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:38.646405 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:38.646560 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:38.647499 (+ 939us) server_negotiation.cc:299] Negotiation successful
0806 19:28:38.647844 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517}
I20260806 19:28:38.649366 28942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:38.622154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.65:48313)
0806 19:28:38.623911 (+ 1757us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:38.623932 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:38.624157 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:38.624629 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:38.624634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:38.625891 (+ 1257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:38.627580 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:38.627604 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.629687 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.629694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:38.632992 (+ 3298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:38.633029 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:38.635164 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:38.635173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:38.635477 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:38.636521 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:38.636546 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:38.638870 (+ 2324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:38.643862 (+ 4992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:38.643869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:38.643873 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:38.644829 (+ 956us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:38.645486 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:38.645492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:38.645497 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:38.645761 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:38.646558 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:38.646563 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:38.647091 (+ 528us) client_negotiation.cc:769] Sending connection context
0806 19:28:38.647278 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 19:28:38.648125 (+ 847us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1510,"thread_start_us":1200,"threads_started":1}
I20260806 19:28:38.670445 28810 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:40339
I20260806 19:28:38.670608 29001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:40339 every 8 connection(s)
I20260806 19:28:38.672271 28810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:38.675994 29002 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42297
I20260806 19:28:38.676354 29002 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:38.677731 29002 heartbeater.cc:511] Master 127.17.18.126:42297 requested a full tablet report, sending...
I20260806 19:28:38.679569 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 28810
I20260806 19:28:38.679922 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:38.680877 17481 external_mini_cluster.cc:1428] Setting key 3e1d0740876121f75daa32b5734b0967
I20260806 19:28:38.680889 28676 ts_manager.cc:194] Registered new tserver with Master: cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339)
I20260806 19:28:38.684015 28676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:36737
WARNING: no policy specified for oryx/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
I20260806 19:28:38.748917 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42297
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:39.247495 29008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:39.247810 29008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:39.247918 29008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:39.255301 29008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:39.255434 29008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:39.255520 29008 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:28:39.255604 29008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:39.265906 29008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:39.267249 29008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:39.268663 29008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:39.283324 29014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:39.283396 29018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:39.283368 29020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:39.284353 29008 server_base.cc:1034] running on GCE node
I20260806 19:28:39.285055 29008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:39.286185 29008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:39.287436 29008 hybrid_clock.cc:648] HybridClock initialized: now 1786044519287365 us; error 46 us; skew 500 ppm
I20260806 19:28:39.287770 29008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:39 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044519, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:39.291317 29008 init.cc:377] Logged in from keytab as oryx/127.17.18.66@KRBTEST.COM (short username oryx)
I20260806 19:28:39.293144 29008 webserver.cc:460] Webserver started at http://127.17.18.66:39987/ using document root <none> and password file <none>
I20260806 19:28:39.294019 29008 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:39.294152 29008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:39.294502 29008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:39.297844 29008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "d9a62e2a80f94055a7a2529dbedbc62b"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "5240cf451662b900a0611ee6cacd59fb"
server_key_iv: "112dc7339ea034ee1528f2a72e0a910d"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.298722 29008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "d9a62e2a80f94055a7a2529dbedbc62b"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "5240cf451662b900a0611ee6cacd59fb"
server_key_iv: "112dc7339ea034ee1528f2a72e0a910d"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.304471 29008 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 19:28:39.308845 29029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:39.310567 29008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:28:39.310732 29008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "d9a62e2a80f94055a7a2529dbedbc62b"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "5240cf451662b900a0611ee6cacd59fb"
server_key_iv: "112dc7339ea034ee1528f2a72e0a910d"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.310942 29008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:39.334909 29008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:39.340139 29008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:39.340444 29008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:39.343554 29008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:39.343657 29008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:39.343808 29008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:39.343875 29008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:28:39 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044519, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:39.368923 29040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.344333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:40817 (local address 127.17.18.126:42297)
0806 19:28:39.344842 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:39.344848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:39.346220 (+ 1372us) server_negotiation.cc:407] Connection header received
0806 19:28:39.348861 (+ 2641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:39.348869 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:39.348983 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:39.349141 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:39.351564 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.352824 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.355372 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.355990 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.356124 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.361196 (+ 5072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:39.361203 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:39.361208 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:39.361254 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:39.365139 (+ 3885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.366344 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.366351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.366356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.366504 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.366979 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.366984 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.366987 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.367298 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:39.367464 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:39.368270 (+ 806us) server_negotiation.cc:299] Negotiation successful
0806 19:28:39.368534 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":247,"threads_started":1}
I20260806 19:28:39.370286 29041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.345050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.66:40817)
0806 19:28:39.346003 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:39.346075 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:39.348409 (+ 2334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:39.349506 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:39.349521 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:39.350335 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:39.351285 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.351316 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.353053 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.353069 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.355179 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.355204 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.356268 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.356276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.356608 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.357495 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:39.357528 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:39.360860 (+ 3332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:39.365399 (+ 4539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.365413 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.365440 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.366189 (+ 749us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.366629 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.366634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.366637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.366848 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.367440 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:39.367449 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:39.367861 (+ 412us) client_negotiation.cc:769] Sending connection context
0806 19:28:39.368128 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 19:28:39.368739 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":403,"threads_started":1}
I20260806 19:28:39.391664 29008 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45697
I20260806 19:28:39.391723 29225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45697 every 8 connection(s)
I20260806 19:28:39.393568 29008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:39.393703 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.376813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.66:43171)
0806 19:28:39.377617 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:39.377638 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:39.377843 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:39.378278 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:39.378283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:39.378997 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:39.379451 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.379468 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.380577 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.380583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.382625 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.382646 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.383601 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.383608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.383837 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.384622 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:39.384654 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:39.386151 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:39.390081 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.390086 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.390090 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.390778 (+ 688us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.391354 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.391358 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.391361 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.391564 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.392598 (+ 1034us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:39.392603 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:39.392802 (+ 199us) client_negotiation.cc:769] Sending connection context
0806 19:28:39.392929 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 19:28:39.393265 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":385,"threads_started":1}
I20260806 19:28:39.393760 29040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.376834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:43171 (local address 127.17.18.126:42297)
0806 19:28:39.377052 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:39.377075 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:39.377759 (+ 684us) server_negotiation.cc:407] Connection header received
0806 19:28:39.378036 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:39.378042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:39.378121 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:39.378217 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:39.379662 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.380412 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.382847 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.383348 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.383473 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.386469 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:39.386476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:39.386479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:39.386519 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:39.389906 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.390994 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.391001 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.391006 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.391196 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.391726 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.391731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.391734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.392421 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:39.392600 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:39.393106 (+ 506us) server_negotiation.cc:299] Negotiation successful
0806 19:28:39.393447 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:28:39.396067 29227 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42297
I20260806 19:28:39.396332 29227 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:39.397055 29227 heartbeater.cc:511] Master 127.17.18.126:42297 requested a full tablet report, sending...
I20260806 19:28:39.398780 28676 ts_manager.cc:194] Registered new tserver with Master: d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697)
I20260806 19:28:39.399675 28676 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:40817
I20260806 19:28:39.401666 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 29008
I20260806 19:28:39.401877 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:39.402295 17481 external_mini_cluster.cc:1428] Setting key 786ae56f3c48932a8a4b34cce0e773d1
WARNING: no policy specified for oryx/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
I20260806 19:28:39.463189 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42297
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:40965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:28:39.687863 29002 heartbeater.cc:503] Master 127.17.18.126:42297 was elected leader, sending a full tablet report...
W20260806 19:28:39.826227 29232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:39.826551 29232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:39.826663 29232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:39.834245 29232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:39.834375 29232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:39.834460 29232 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 19:28:39.834546 29232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:39.844761 29232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:40965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.18.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:39.846211 29232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:39.847625 29232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:39.862571 29237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:39.862643 29240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:39.862607 29242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:39.863853 29232 server_base.cc:1034] running on GCE node
I20260806 19:28:39.864584 29232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:39.865688 29232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:39.866940 29232 hybrid_clock.cc:648] HybridClock initialized: now 1786044519866851 us; error 57 us; skew 500 ppm
I20260806 19:28:39.867282 29232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:39 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044519, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:39.876631 29232 init.cc:377] Logged in from keytab as oryx/127.17.18.67@KRBTEST.COM (short username oryx)
I20260806 19:28:39.878509 29232 webserver.cc:460] Webserver started at http://127.17.18.67:42823/ using document root <none> and password file <none>
I20260806 19:28:39.879314 29232 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:39.879436 29232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:39.879789 29232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:39.883066 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "25595b266285495fa579fb2df00f30d7"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "7ee392081344d6eebe9da336910e010a"
server_key_iv: "500234c5a10efe4db013a1a0385b359b"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.883949 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "25595b266285495fa579fb2df00f30d7"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "7ee392081344d6eebe9da336910e010a"
server_key_iv: "500234c5a10efe4db013a1a0385b359b"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.889663 29232 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 19:28:39.893978 29250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:39.895656 29232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:28:39.895848 29232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "25595b266285495fa579fb2df00f30d7"
format_stamp: "Formatted at 2026-08-06 19:28:39 on dist-test-slave-f0tn"
server_key: "7ee392081344d6eebe9da336910e010a"
server_key_iv: "500234c5a10efe4db013a1a0385b359b"
server_key_version: "encryptionkey@0"
I20260806 19:28:39.896117 29232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:39.912649 29232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:39.917943 29232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:39.918279 29232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:39.921689 29232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:39.921846 29232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:39.922055 29232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:39.922216 29232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 06 19:28:39 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044519, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:39.949134 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.922270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:36435 (local address 127.17.18.126:42297)
0806 19:28:39.922775 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:39.922783 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:39.924280 (+ 1497us) server_negotiation.cc:407] Connection header received
0806 19:28:39.927400 (+ 3120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:39.927408 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:39.927520 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:39.927642 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:39.930550 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.931479 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.933654 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.934233 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.934381 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.940173 (+ 5792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:39.940184 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:39.940189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:39.940243 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:39.944217 (+ 3974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.945478 (+ 1261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.945485 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.945489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.945703 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.946263 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.946270 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.946274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.946718 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:39.946894 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:39.948418 (+ 1524us) server_negotiation.cc:299] Negotiation successful
0806 19:28:39.948671 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":235,"threads_started":1}
I20260806 19:28:39.950357 29268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.922853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.67:36435)
0806 19:28:39.924011 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:39.924086 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:39.926924 (+ 2838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:39.928032 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:39.928046 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:39.928970 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:39.930195 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.930238 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.931763 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.931772 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.933471 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.933487 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.934534 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.934542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.934948 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.935990 (+ 1042us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:39.936024 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:39.939809 (+ 3785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:39.944444 (+ 4635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.944458 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.944486 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.945280 (+ 794us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.945866 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.945870 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.945872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.946101 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.946914 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:39.946927 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:39.947497 (+ 570us) client_negotiation.cc:769] Sending connection context
0806 19:28:39.947891 (+ 394us) client_negotiation.cc:240] Negotiation successful
0806 19:28:39.948668 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":472,"threads_started":1}
I20260806 19:28:39.980098 29232 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:37143
I20260806 19:28:39.980121 29421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:37143 every 8 connection(s)
I20260806 19:28:39.981781 29232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:39.982918 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.964679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:52975 (local address 127.17.18.126:42297)
0806 19:28:39.964895 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:39.964902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:39.966192 (+ 1290us) server_negotiation.cc:407] Connection header received
0806 19:28:39.966383 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:39.966389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:39.966513 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:39.966658 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:39.967838 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.969057 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.971024 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.971742 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.971903 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.975108 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:39.975119 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:39.975124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:39.975301 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:39.979298 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.980490 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.980496 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.980499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.980688 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:39.981117 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:39.981120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:39.981122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:39.981487 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:39.981613 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:39.982230 (+ 617us) server_negotiation.cc:299] Negotiation successful
0806 19:28:39.982488 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 19:28:39.983291 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 29232
I20260806 19:28:39.983518 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:39.984104 17481 external_mini_cluster.cc:1428] Setting key 54c9b822396efcc494b7891cbb242b20
I20260806 19:28:39.984326 29385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:39.964647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.17.18.67:52975)
0806 19:28:39.966034 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:39.966058 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:39.966247 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:39.966813 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:39.966818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:39.967327 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:39.967661 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.967673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.969257 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.969261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.970812 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:39.970831 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:39.972001 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:39.972010 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:39.972300 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:39.973081 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:39.973113 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:39.974735 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:39.979549 (+ 4814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.979558 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.979562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.980309 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.980829 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:39.980834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:39.980837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:39.981011 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:39.981610 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:39.981615 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:39.981874 (+ 259us) client_negotiation.cc:769] Sending connection context
0806 19:28:39.982059 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 19:28:39.982487 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1196,"thread_start_us":853,"threads_started":1}
I20260806 19:28:39.984606 29422 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42297
I20260806 19:28:39.984884 29422 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:39.986052 29422 heartbeater.cc:511] Master 127.17.18.126:42297 requested a full tablet report, sending...
I20260806 19:28:39.988723 28675 ts_manager.cc:194] Registered new tserver with Master: 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:39.989706 28675 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:36435
I20260806 19:28:40.001694 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 19:28:40 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044520, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 19:28:40 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:40 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:40.402732 29227 heartbeater.cc:503] Master 127.17.18.126:42297 was elected leader, sending a full tablet report...
I20260806 19:28:40.992583 29422 heartbeater.cc:503] Master 127.17.18.126:42297 was elected leader, sending a full tablet report...
W20260806 19:28:41.071038 29432 sasl_common.cc:323] Time spent calling sasl_client_start(): real 0.994s user 0.009s sys 0.009s
W20260806 19:28:41.072220 29262 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:40.070712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.17.18.126:42297)
0806 19:28:40.070910 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:40.070914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:40.071193 (+ 279us) server_negotiation.cc:407] Connection header received
0806 19:28:40.071381 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:40.071386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:40.071459 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:40.071588 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:40.073295 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:40.074106 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:40.075434 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:40.075868 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:40.075970 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.071953 (+995983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52654: BlockingRecv error: recv got EOF from 127.0.0.1:52654 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044520, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:41.094509 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.076170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52670 (local address 127.17.18.126:42297)
0806 19:28:41.076400 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.076406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.076719 (+ 313us) server_negotiation.cc:407] Connection header received
0806 19:28:41.076847 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.076851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.076921 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.077016 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:41.078391 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.079147 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.080470 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.080929 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.081060 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.088860 (+ 7800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:41.088867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:41.088870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:41.088918 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:41.091595 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.092400 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.092405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.092408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.092560 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.092953 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.092957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.092959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.093262 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:41.093570 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.093925 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.094193 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:28:41.099291 28675 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:41.106820 28675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:41.145323 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.122439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48770 (local address 127.17.18.66:45697)
0806 19:28:41.134284 (+ 11845us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.134298 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.135190 (+ 892us) server_negotiation.cc:407] Connection header received
0806 19:28:41.135603 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.135615 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.135962 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.136233 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.137306 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.139189 (+ 1883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.141751 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.143945 (+ 2194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.144101 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.144352 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.144693 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.144878 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11573,"thread_start_us":11868,"threads_started":1}
I20260806 19:28:41.145370 29457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.121864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45697 (local address 127.0.0.1:48770)
0806 19:28:41.135043 (+ 13179us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.135063 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.135346 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.136546 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.136555 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.136600 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.137046 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.137062 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.139344 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.139350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.141410 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.141429 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.144191 (+ 2762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.144198 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.144414 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.144465 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.144600 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.144851 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13051,"thread_start_us":7155,"threads_started":1}
I20260806 19:28:41.146375 29453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.121501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37143 (local address 127.0.0.1:53646)
0806 19:28:41.129532 (+ 8031us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.129593 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.129853 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.137906 (+ 8053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.137915 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.137944 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.138421 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.138435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.140439 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.140445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.142823 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.142840 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.144837 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.144849 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.145502 (+ 653us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.145620 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.145742 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.145883 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7662,"mutex_wait_us":107,"thread_start_us":14613,"threads_started":1}
I20260806 19:28:41.146421 29451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.130444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40339 (local address 127.0.0.1:40532)
0806 19:28:41.135851 (+ 5407us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.135871 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.135988 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.137490 (+ 1502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.137495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.137525 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.137940 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.137957 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.140451 (+ 2494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.140457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.142950 (+ 2493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.142965 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.144868 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.144970 (+ 102us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.145523 (+ 553us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.145623 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.145720 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.145883 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5286,"mutex_wait_us":204,"thread_start_us":4308,"threads_started":1}
I20260806 19:28:41.146958 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.130814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.17.18.65:40339)
0806 19:28:41.136817 (+ 6003us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.136827 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.136858 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:28:41.136971 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.136981 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.137269 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.137513 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.138178 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.140281 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.143137 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.144617 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.145989 (+ 1372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.146295 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.146459 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.146659 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5812,"thread_start_us":5668,"threads_started":1}
I20260806 19:28:41.148674 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.121770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53646 (local address 127.17.18.67:37143)
0806 19:28:41.137216 (+ 15446us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.137224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.137258 (+ 34us) server_negotiation.cc:407] Connection header received
0806 19:28:41.137369 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.137402 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.137637 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.138457 (+ 820us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.138680 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.140257 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.143028 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.144555 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.147509 (+ 2954us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.147874 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.147970 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.148159 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15297,"thread_start_us":15149,"threads_started":1}
I20260806 19:28:41.150358 29103 tablet_service.cc:1467] Processing CreateTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e (DEFAULT_TABLE table=test-table [id=047c99f01b7d4e21b0833e0e80291125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.151760 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f74121247c14c899f9b6a3e8fe25d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.151314 28906 tablet_service.cc:1467] Processing CreateTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e (DEFAULT_TABLE table=test-table [id=047c99f01b7d4e21b0833e0e80291125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.152789 28906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f74121247c14c899f9b6a3e8fe25d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.155611 29326 tablet_service.cc:1467] Processing CreateTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e (DEFAULT_TABLE table=test-table [id=047c99f01b7d4e21b0833e0e80291125]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.157487 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f74121247c14c899f9b6a3e8fe25d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.167125 29459 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Bootstrap starting.
I20260806 19:28:41.171501 29459 tablet_bootstrap.cc:654] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.172621 29461 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Bootstrap starting.
I20260806 19:28:41.173488 29459 log.cc:824] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:41.176932 29461 tablet_bootstrap.cc:654] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.177269 29463 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Bootstrap starting.
I20260806 19:28:41.177371 29459 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: No bootstrap required, opened a new log
I20260806 19:28:41.177747 29459 ts_tablet_manager.cc:1397] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260806 19:28:41.179529 29461 log.cc:824] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:41.180845 29463 tablet_bootstrap.cc:654] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.182081 29463 log.cc:824] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:41.183346 29461 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: No bootstrap required, opened a new log
I20260806 19:28:41.183670 29461 ts_tablet_manager.cc:1397] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 19:28:41.185024 29463 tablet_bootstrap.cc:492] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: No bootstrap required, opened a new log
I20260806 19:28:41.185312 29463 ts_tablet_manager.cc:1397] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 19:28:41.188557 29459 raft_consensus.cc:348] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.189275 29459 raft_consensus.cc:374] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.189471 29459 raft_consensus.cc:729] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc95c663c01745d9838f93b5f6370209, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.190279 29459 consensus_queue.cc:260] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.192299 29459 ts_tablet_manager.cc:1428] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260806 19:28:41.194622 29463 raft_consensus.cc:348] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.195042 29463 raft_consensus.cc:374] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.195153 29463 raft_consensus.cc:729] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.195452 29461 raft_consensus.cc:348] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.195926 29461 raft_consensus.cc:374] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.196045 29461 raft_consensus.cc:729] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.195919 29463 consensus_queue.cc:260] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.196717 29461 consensus_queue.cc:260] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.198735 29463 ts_tablet_manager.cc:1428] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260806 19:28:41.200318 29461 ts_tablet_manager.cc:1428] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Time spent starting tablet: real 0.017s user 0.014s sys 0.002s
I20260806 19:28:41.221423 29469 raft_consensus.cc:482] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:41.221822 29469 raft_consensus.cc:504] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.223632 29469 leader_election.cc:288] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697), cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339)
I20260806 19:28:41.233892 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.225154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:39607 (local address 127.17.18.65:40339)
0806 19:28:41.225430 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.225435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.225626 (+ 191us) server_negotiation.cc:407] Connection header received
0806 19:28:41.225781 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.225787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.225879 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.225981 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.226620 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.227670 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.231237 (+ 3567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.232527 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.232753 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.232827 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.233443 (+ 616us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.233603 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 19:28:41.233892 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.224346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:47671 (local address 127.17.18.66:45697)
0806 19:28:41.224625 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.224632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.224899 (+ 267us) server_negotiation.cc:407] Connection header received
0806 19:28:41.225181 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.225189 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.225287 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.225365 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.226383 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.227472 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.231274 (+ 3802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.232527 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.232741 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.232827 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.233451 (+ 624us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.233603 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 19:28:41.234115 29471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.224008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45697 (local address 127.17.18.67:47671)
0806 19:28:41.224750 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.224773 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.224960 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.225612 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.225617 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.225732 (+ 115us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.226218 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.226232 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.227881 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.227891 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.230927 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.230959 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.232903 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.232911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.233185 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.233248 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.233363 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.233587 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":228,"spinlock_wait_cycles":33152,"thread_start_us":358,"threads_started":1}
I20260806 19:28:41.234287 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.224827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40339 (local address 127.17.18.67:39607)
0806 19:28:41.225522 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.225539 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.225661 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.226047 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.226050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.226101 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.226435 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.226443 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.227881 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.227891 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.230927 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.230959 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.232888 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.232896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.233182 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.233251 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.233361 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.233587 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":272,"thread_start_us":337,"threads_started":1}
I20260806 19:28:41.235402 29138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f74121247c14c899f9b6a3e8fe25d8e" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" is_pre_election: true
I20260806 19:28:41.235522 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f74121247c14c899f9b6a3e8fe25d8e" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209" is_pre_election: true
I20260806 19:28:41.235963 29138 raft_consensus.cc:2454] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 0.
I20260806 19:28:41.236021 28938 raft_consensus.cc:2454] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 0.
I20260806 19:28:41.236718 29251 leader_election.cc:302] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, cc95c663c01745d9838f93b5f6370209; no voters:
I20260806 19:28:41.237217 29469 raft_consensus.cc:2781] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:41.237421 29469 raft_consensus.cc:482] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:41.237537 29469 raft_consensus.cc:3037] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Advancing to term 1
W20260806 19:28:41.239012 29423 tablet.cc:2369] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:41.240495 29469 raft_consensus.cc:504] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.241120 29469 leader_election.cc:288] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 election: Requested vote from peers d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697), cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339)
I20260806 19:28:41.241772 29138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f74121247c14c899f9b6a3e8fe25d8e" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a62e2a80f94055a7a2529dbedbc62b"
I20260806 19:28:41.241859 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f74121247c14c899f9b6a3e8fe25d8e" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209"
I20260806 19:28:41.241993 29138 raft_consensus.cc:3037] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.242090 28938 raft_consensus.cc:3037] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.244371 29138 raft_consensus.cc:2454] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 1.
I20260806 19:28:41.244431 28938 raft_consensus.cc:2454] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 1.
I20260806 19:28:41.244865 29251 leader_election.cc:302] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, cc95c663c01745d9838f93b5f6370209; no voters:
I20260806 19:28:41.245214 29469 raft_consensus.cc:2781] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:41.245720 29469 raft_consensus.cc:686] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 1 LEADER]: Becoming Leader. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Running, Role: LEADER
I20260806 19:28:41.246241 29469 consensus_queue.cc:237] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } }
I20260806 19:28:41.251540 28675 catalog_manager.cc:5495] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25595b266285495fa579fb2df00f30d7 (127.17.18.67). New cstate: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260806 19:28:41.277540 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.271731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53662 (local address 127.17.18.67:37143)
0806 19:28:41.271929 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.271933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.271953 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:28:41.272155 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.272159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.272283 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.272441 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:41.272871 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.273713 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.275261 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.275684 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.275804 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.276304 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.276883 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.277024 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.277123 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.277237 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:28:41.286509 29138 raft_consensus.cc:1261] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Refusing update from remote peer 25595b266285495fa579fb2df00f30d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.286486 28938 raft_consensus.cc:1261] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Refusing update from remote peer 25595b266285495fa579fb2df00f30d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.287634 29473 consensus_queue.cc:1035] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.288030 29469 consensus_queue.cc:1035] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.298794 29477 mvcc.cc:205] Tried to move back new op lower bound from 7315638359178457088 to 7315638359028350976. Current Snapshot: MvccSnapshot[applied={T|T < 7315638359178457088}]
I20260806 19:28:41.300410 29478 mvcc.cc:205] Tried to move back new op lower bound from 7315638359178457088 to 7315638359028350976. Current Snapshot: MvccSnapshot[applied={T|T < 7315638359178457088}]
I20260806 19:28:41.317730 28675 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:41.318071 28675 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:41.322543 28675 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Sending DeleteTablet for 3 replicas of tablet 2f74121247c14c899f9b6a3e8fe25d8e
I20260806 19:28:41.324142 29326 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:53646
I20260806 19:28:41.324113 28906 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40532
I20260806 19:28:41.325724 29103 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f74121247c14c899f9b6a3e8fe25d8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48770
I20260806 19:28:41.325332 28676 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:41.327148 28676 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:41.336587 29492 tablet_replica.cc:330] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: stopping tablet replica
I20260806 19:28:41.338088 28905 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbf68048b08421cabfd4e23601e0239 (DEFAULT_TABLE table=test-table [id=2efd06dea05f4725b452c0cba6f61424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.338105 29325 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbf68048b08421cabfd4e23601e0239 (DEFAULT_TABLE table=test-table [id=2efd06dea05f4725b452c0cba6f61424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.338783 28905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbf68048b08421cabfd4e23601e0239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.338799 29325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbf68048b08421cabfd4e23601e0239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.346292 29463 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Bootstrap starting.
I20260806 19:28:41.346148 29103 tablet_service.cc:1467] Processing CreateTablet for tablet 3fbf68048b08421cabfd4e23601e0239 (DEFAULT_TABLE table=test-table [id=2efd06dea05f4725b452c0cba6f61424]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.347560 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fbf68048b08421cabfd4e23601e0239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.348358 29463 tablet_bootstrap.cc:654] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.348511 29459 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Bootstrap starting.
I20260806 19:28:41.350224 29459 tablet_bootstrap.cc:654] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.352059 29492 raft_consensus.cc:2229] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:41.352906 29490 tablet_replica.cc:330] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: stopping tablet replica
I20260806 19:28:41.353180 29459 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: No bootstrap required, opened a new log
I20260806 19:28:41.353856 29490 raft_consensus.cc:2229] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:41.354264 29492 raft_consensus.cc:2258] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.354401 29461 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Bootstrap starting.
I20260806 19:28:41.355093 29459 ts_tablet_manager.cc:1397] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260806 19:28:41.355338 29490 raft_consensus.cc:2258] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.356241 29461 tablet_bootstrap.cc:654] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.356348 29459 raft_consensus.cc:348] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.356645 29459 raft_consensus.cc:374] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.356736 29459 raft_consensus.cc:729] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc95c663c01745d9838f93b5f6370209, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.356827 29491 tablet_replica.cc:330] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: stopping tablet replica
I20260806 19:28:41.357283 29491 raft_consensus.cc:2229] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:41.358935 29492 ts_tablet_manager.cc:1905] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.357074 29459 consensus_queue.cc:260] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.360565 29459 ts_tablet_manager.cc:1428] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260806 19:28:41.361653 29491 raft_consensus.cc:2258] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.362838 29490 ts_tablet_manager.cc:1905] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.365515 29491 ts_tablet_manager.cc:1905] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.366988 29463 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: No bootstrap required, opened a new log
I20260806 19:28:41.367188 29463 ts_tablet_manager.cc:1397] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.005s
I20260806 19:28:41.368201 29463 raft_consensus.cc:348] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.365973 29461 tablet_bootstrap.cc:492] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: No bootstrap required, opened a new log
I20260806 19:28:41.373394 29461 ts_tablet_manager.cc:1397] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260806 19:28:41.374450 29461 raft_consensus.cc:348] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.374720 29461 raft_consensus.cc:374] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.374836 29461 raft_consensus.cc:729] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.375133 29461 consensus_queue.cc:260] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.375881 29461 ts_tablet_manager.cc:1428] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:41.376166 29463 raft_consensus.cc:374] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.376296 29463 raft_consensus.cc:729] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.376614 29463 consensus_queue.cc:260] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.377357 29463 ts_tablet_manager.cc:1428] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260806 19:28:41.373039 29490 ts_tablet_manager.cc:1918] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:41.377671 29490 log.cc:1196] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/2f74121247c14c899f9b6a3e8fe25d8e
I20260806 19:28:41.378286 29490 ts_tablet_manager.cc:1939] T 2f74121247c14c899f9b6a3e8fe25d8e P 25595b266285495fa579fb2df00f30d7: Deleting consensus metadata
I20260806 19:28:41.378906 29491 ts_tablet_manager.cc:1918] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:41.379217 29491 log.cc:1196] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/2f74121247c14c899f9b6a3e8fe25d8e
I20260806 19:28:41.379896 29491 ts_tablet_manager.cc:1939] T 2f74121247c14c899f9b6a3e8fe25d8e P cc95c663c01745d9838f93b5f6370209: Deleting consensus metadata
I20260806 19:28:41.380512 28657 catalog_manager.cc:4841] TS 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143): tablet 2f74121247c14c899f9b6a3e8fe25d8e (table test-table [id=047c99f01b7d4e21b0833e0e80291125]) successfully deleted
I20260806 19:28:41.383221 29492 ts_tablet_manager.cc:1918] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:41.383477 29492 log.cc:1196] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/2f74121247c14c899f9b6a3e8fe25d8e
I20260806 19:28:41.384080 29492 ts_tablet_manager.cc:1939] T 2f74121247c14c899f9b6a3e8fe25d8e P d9a62e2a80f94055a7a2529dbedbc62b: Deleting consensus metadata
I20260806 19:28:41.384244 28654 catalog_manager.cc:4841] TS cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339): tablet 2f74121247c14c899f9b6a3e8fe25d8e (table test-table [id=047c99f01b7d4e21b0833e0e80291125]) successfully deleted
I20260806 19:28:41.385668 28654 catalog_manager.cc:4841] TS d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697): tablet 2f74121247c14c899f9b6a3e8fe25d8e (table test-table [id=047c99f01b7d4e21b0833e0e80291125]) successfully deleted
W20260806 19:28:41.397140 29228 tablet.cc:2369] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:28:41.428161 29003 tablet.cc:2369] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:28:41.440444 29470 raft_consensus.cc:482] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:41.440737 29470 raft_consensus.cc:504] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.442901 29470 leader_election.cc:288] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:41.451891 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.444033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:38643 (local address 127.17.18.67:37143)
0806 19:28:41.444221 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.444227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.444830 (+ 603us) server_negotiation.cc:407] Connection header received
0806 19:28:41.445170 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.445177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.445297 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.445424 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.446535 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.447596 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.449463 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.450565 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.450743 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.450823 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.451372 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.451515 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:28:41.452294 29458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.443540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:36165 (local address 127.17.18.65:40339)
0806 19:28:41.443746 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.443753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.445273 (+ 1520us) server_negotiation.cc:407] Connection header received
0806 19:28:41.445453 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.445459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.445540 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.445637 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:28:41.446249 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.447304 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.449935 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.451121 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.451312 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.451382 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.451886 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.452032 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:28:41.452670 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.443150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37143 (local address 127.17.18.66:38643)
0806 19:28:41.444700 (+ 1550us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.444720 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.444977 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.445841 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.445847 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.445879 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.446357 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.446371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.447730 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.447736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.449274 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.449292 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.450988 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.450994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.451180 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.451216 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.452115 (+ 899us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.452269 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"mutex_wait_us":3,"thread_start_us":1224,"threads_started":1}
I20260806 19:28:41.453008 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.443244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40339 (local address 127.17.18.66:36165)
0806 19:28:41.445131 (+ 1887us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.445154 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.445297 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.445663 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.445667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.445706 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:28:41.446019 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.446028 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.447451 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.447457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.449746 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.449763 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.451526 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.451532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.451691 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.451726 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.452482 (+ 756us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.452627 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1768,"thread_start_us":1536,"threads_started":1}
I20260806 19:28:41.453727 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fbf68048b08421cabfd4e23601e0239" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209" is_pre_election: true
I20260806 19:28:41.453733 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fbf68048b08421cabfd4e23601e0239" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7" is_pre_election: true
I20260806 19:28:41.454015 28938 raft_consensus.cc:2454] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:41.454212 29353 raft_consensus.cc:2454] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:41.454533 29030 leader_election.cc:302] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc95c663c01745d9838f93b5f6370209, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:41.455008 29470 raft_consensus.cc:2781] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:41.455128 29470 raft_consensus.cc:482] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:41.455230 29470 raft_consensus.cc:3037] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.457595 29470 raft_consensus.cc:504] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.458212 29470 leader_election.cc:288] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Requested vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:41.458817 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fbf68048b08421cabfd4e23601e0239" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7"
I20260806 19:28:41.458839 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fbf68048b08421cabfd4e23601e0239" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209"
I20260806 19:28:41.459075 28938 raft_consensus.cc:3037] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.459071 29353 raft_consensus.cc:3037] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.462255 28938 raft_consensus.cc:2454] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:41.462356 29353 raft_consensus.cc:2454] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:41.462888 29030 leader_election.cc:302] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc95c663c01745d9838f93b5f6370209, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:41.463284 29470 raft_consensus.cc:2781] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:41.463830 29470 raft_consensus.cc:686] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Becoming Leader. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Running, Role: LEADER
I20260806 19:28:41.464301 29470 consensus_queue.cc:237] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.468750 28675 catalog_manager.cc:5495] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66). New cstate: current_term: 1 leader_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } health_report { overall_health: UNKNOWN } } }
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044517, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.126@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:41.517342 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.500110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52686 (local address 127.17.18.126:42297)
0806 19:28:41.500394 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.500398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.501149 (+ 751us) server_negotiation.cc:407] Connection header received
0806 19:28:41.501332 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.501336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.501439 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.501526 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:41.503063 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.504217 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.505830 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.506481 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.506617 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.510552 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:41.510560 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:41.510564 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:41.510599 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:41.514014 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.514900 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.514904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.514907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.515057 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.515649 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.515655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.515658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.516027 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:41.516148 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.516679 (+ 531us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.517047 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":160,"server-negotiator.queue_time_us":144}
I20260806 19:28:41.517416 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.500281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42297 (local address 127.0.0.1:52686)
0806 19:28:41.501037 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.501057 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.501221 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.501570 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.501574 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.502511 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:41.502882 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.502896 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.504388 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.504394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.505689 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.505702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.506693 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.506704 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.506846 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.507584 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:41.507603 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:41.510287 (+ 2684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:41.514170 (+ 3883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:41.514185 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:41.514195 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:41.514748 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:41.515196 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:41.515219 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:41.515223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:41.515507 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:41.516166 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:41.516176 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:41.516398 (+ 222us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.516594 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.516921 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":402,"threads_started":1}
I20260806 19:28:41.523280 28675 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:52686:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 19:28:41.524614 28675 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:41.532742 28906 tablet_service.cc:1467] Processing CreateTablet for tablet 28afc2fb7bd54c23b9f78c8641436e32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aaa6c3a01846483c9ee0de0f536eb67d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:28:41.532970 29103 tablet_service.cc:1467] Processing CreateTablet for tablet 28afc2fb7bd54c23b9f78c8641436e32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aaa6c3a01846483c9ee0de0f536eb67d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:28:41.533476 28906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28afc2fb7bd54c23b9f78c8641436e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.533593 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28afc2fb7bd54c23b9f78c8641436e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.533595 29326 tablet_service.cc:1467] Processing CreateTablet for tablet 28afc2fb7bd54c23b9f78c8641436e32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=aaa6c3a01846483c9ee0de0f536eb67d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 19:28:41.534168 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28afc2fb7bd54c23b9f78c8641436e32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.540904 29461 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: Bootstrap starting.
I20260806 19:28:41.542538 29463 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: Bootstrap starting.
I20260806 19:28:41.542735 29461 tablet_bootstrap.cc:654] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.544544 29463 tablet_bootstrap.cc:654] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.545948 29459 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: Bootstrap starting.
I20260806 19:28:41.547897 29459 tablet_bootstrap.cc:654] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.549772 29461 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: No bootstrap required, opened a new log
I20260806 19:28:41.550024 29461 ts_tablet_manager.cc:1397] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.004s
I20260806 19:28:41.550078 29463 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: No bootstrap required, opened a new log
I20260806 19:28:41.550328 29463 ts_tablet_manager.cc:1397] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260806 19:28:41.550997 29461 raft_consensus.cc:348] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.551126 29463 raft_consensus.cc:348] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.551381 29461 raft_consensus.cc:374] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.551432 29463 raft_consensus.cc:374] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.551484 29459 tablet_bootstrap.cc:492] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: No bootstrap required, opened a new log
I20260806 19:28:41.551544 29463 raft_consensus.cc:729] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.551570 29461 raft_consensus.cc:729] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.551687 29459 ts_tablet_manager.cc:1397] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260806 19:28:41.551827 29463 consensus_queue.cc:260] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.552011 29461 consensus_queue.cc:260] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.552287 29473 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.552606 29473 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.552546 29470 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.552841 29470 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.553288 29459 raft_consensus.cc:348] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.553572 29459 raft_consensus.cc:374] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.553656 29459 raft_consensus.cc:729] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc95c663c01745d9838f93b5f6370209, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.553901 29459 consensus_queue.cc:260] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.554531 29459 ts_tablet_manager.cc:1428] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 19:28:41.555593 29467 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.556005 29467 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.556159 29461 ts_tablet_manager.cc:1428] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260806 19:28:41.557006 29463 ts_tablet_manager.cc:1428] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260806 19:28:41.569187 29473 raft_consensus.cc:482] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:41.569463 29473 raft_consensus.cc:504] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.570154 29473 leader_election.cc:288] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697)
I20260806 19:28:41.570742 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28afc2fb7bd54c23b9f78c8641436e32" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209" is_pre_election: true
I20260806 19:28:41.570969 28938 raft_consensus.cc:2454] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 0.
I20260806 19:28:41.570875 29138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28afc2fb7bd54c23b9f78c8641436e32" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" is_pre_election: true
I20260806 19:28:41.571111 29138 raft_consensus.cc:2454] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 0.
I20260806 19:28:41.571421 29251 leader_election.cc:302] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, cc95c663c01745d9838f93b5f6370209; no voters:
I20260806 19:28:41.571722 29473 raft_consensus.cc:2781] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:41.571877 29473 raft_consensus.cc:482] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:41.571974 29473 raft_consensus.cc:3037] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.574728 29473 raft_consensus.cc:504] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.575327 29473 leader_election.cc:288] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 election: Requested vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697)
I20260806 19:28:41.575884 29138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28afc2fb7bd54c23b9f78c8641436e32" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9a62e2a80f94055a7a2529dbedbc62b"
I20260806 19:28:41.575997 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28afc2fb7bd54c23b9f78c8641436e32" candidate_uuid: "25595b266285495fa579fb2df00f30d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209"
I20260806 19:28:41.576129 29138 raft_consensus.cc:3037] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.576249 28938 raft_consensus.cc:3037] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:41.578336 28938 raft_consensus.cc:2454] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 1.
I20260806 19:28:41.578779 29251 leader_election.cc:302] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, cc95c663c01745d9838f93b5f6370209; no voters:
I20260806 19:28:41.579051 29473 raft_consensus.cc:2781] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:41.579082 29138 raft_consensus.cc:2454] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25595b266285495fa579fb2df00f30d7 in term 1.
I20260806 19:28:41.579252 29473 raft_consensus.cc:686] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [term 1 LEADER]: Becoming Leader. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Running, Role: LEADER
I20260806 19:28:41.579878 29473 consensus_queue.cc:237] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.581627 29469 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: TxnStatusTablet state changed. Reason: New leader 25595b266285495fa579fb2df00f30d7. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.581959 29469 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:28:41.583290 28676 catalog_manager.cc:5495] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25595b266285495fa579fb2df00f30d7 (127.17.18.67). New cstate: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } health_report { overall_health: HEALTHY } } }
I20260806 19:28:41.585968 29514 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 19:28:41.586256 29514 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 19:28:41.605940 29507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.600454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37143 (local address 127.0.0.1:53670)
0806 19:28:41.600739 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.600762 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.600960 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.601472 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.601476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.601491 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:28:41.601678 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.601686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.602799 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.602803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.603823 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.603836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.604644 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.604651 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.604836 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.604904 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.605318 (+ 414us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.605342 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.605444 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.605619 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 19:28:41.606153 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.600611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53670 (local address 127.17.18.67:37143)
0806 19:28:41.600848 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.600854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.600879 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:28:41.601170 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.601176 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.601313 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.601427 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:41.601839 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.602660 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.603972 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.604475 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.604599 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.605092 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.605219 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.605303 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.605736 (+ 433us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.605837 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 19:28:41.610350 29138 raft_consensus.cc:1261] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Refusing update from remote peer 25595b266285495fa579fb2df00f30d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.610450 28938 raft_consensus.cc:1261] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Refusing update from remote peer 25595b266285495fa579fb2df00f30d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.611112 29469 consensus_queue.cc:1035] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.611435 29473 consensus_queue.cc:1035] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.615041 29470 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: TxnStatusTablet state changed. Reason: New leader 25595b266285495fa579fb2df00f30d7. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.615420 29470 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.616878 29469 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.617192 29469 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:28:41.619345 29479 mvcc.cc:205] Tried to move back new op lower bound from 7315638360509304832 to 7315638360393859072. Current Snapshot: MvccSnapshot[applied={T|T < 7315638360509304832}]
I20260806 19:28:41.621157 29470 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.621502 29470 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P d9a62e2a80f94055a7a2529dbedbc62b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.621356 29467 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: TxnStatusTablet state changed. Reason: New leader 25595b266285495fa579fb2df00f30d7. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.621670 29467 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.623059 29473 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.623404 29473 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P 25595b266285495fa579fb2df00f30d7: This TxnStatusTablet replica's current role is: LEADER
I20260806 19:28:41.629129 29467 tablet_replica.cc:439] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25595b266285495fa579fb2df00f30d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } } }
I20260806 19:28:41.629506 29467 tablet_replica.cc:442] T 28afc2fb7bd54c23b9f78c8641436e32 P cc95c663c01745d9838f93b5f6370209: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 19:28:41.633661 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.627106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.17.18.66:45697)
0806 19:28:41.627313 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.627317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.627332 (+ 15us) server_negotiation.cc:407] Connection header received
0806 19:28:41.627424 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.627429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.627508 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.627651 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:41.628068 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.629114 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.631090 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.631671 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.631792 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.632368 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.632952 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.633100 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.633213 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.633304 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 19:28:41.652964 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.646416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:37143 (local address 127.17.18.66:36065)
0806 19:28:41.647073 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.647094 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.647274 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.647685 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.647696 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.647706 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:28:41.648037 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.648051 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.649557 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.649560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.650702 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.650717 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.651773 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.651778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.651906 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.651970 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.652439 (+ 469us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.652447 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.652508 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.652634 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":306,"threads_started":1}
I20260806 19:28:41.652964 29452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.646648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:36065 (local address 127.17.18.67:37143)
0806 19:28:41.646881 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.646887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.647208 (+ 321us) server_negotiation.cc:407] Connection header received
0806 19:28:41.647434 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.647440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.647541 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.647664 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:41.648217 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.649414 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.650868 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.651562 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.651696 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.652161 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.652338 (+ 177us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.652441 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.652547 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.652639 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 19:28:41.665282 28938 raft_consensus.cc:1261] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.665369 29353 raft_consensus.cc:1261] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:41.666172 29500 consensus_queue.cc:1035] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.667047 29470 consensus_queue.cc:1035] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:41.737032 29454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.705754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:44299 (local address 127.17.18.66:45697)
0806 19:28:41.705981 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.705987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.729315 (+ 23328us) server_negotiation.cc:407] Connection header received
0806 19:28:41.730779 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.730787 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.730887 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.730957 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:41.731841 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.732970 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.735276 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.735720 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.735824 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.736381 (+ 557us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.736498 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.736561 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.736744 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.736819 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:28:41.737588 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.705177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45697 (local address 127.17.18.67:44299)
0806 19:28:41.729099 (+ 23922us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:41.729123 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:41.729313 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:41.731189 (+ 1876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:41.731195 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:41.731212 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 19:28:41.731621 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.731633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.733152 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.733158 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.735097 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:41.735117 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.735902 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.735909 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:41.736104 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.736207 (+ 103us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 19:28:41.736609 (+ 402us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 19:28:41.736622 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 19:28:41.736710 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:28:41.736879 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23670,"thread_start_us":24260,"threads_started":1}
I20260806 19:28:41.787487 28673 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:41.787829 28673 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:41.792047 28673 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Sending DeleteTablet for 3 replicas of tablet 3fbf68048b08421cabfd4e23601e0239
I20260806 19:28:41.793174 29103 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fbf68048b08421cabfd4e23601e0239 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48770
I20260806 19:28:41.793607 29492 tablet_replica.cc:330] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: stopping tablet replica
I20260806 19:28:41.793864 29492 raft_consensus.cc:2229] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:41.793843 28906 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fbf68048b08421cabfd4e23601e0239 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40532
I20260806 19:28:41.794173 29491 tablet_replica.cc:330] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: stopping tablet replica
I20260806 19:28:41.794407 29491 raft_consensus.cc:2229] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:41.794500 29492 raft_consensus.cc:2258] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.794624 29491 raft_consensus.cc:2258] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.796066 29491 ts_tablet_manager.cc:1905] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.796092 29326 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fbf68048b08421cabfd4e23601e0239 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:41 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:53646
I20260806 19:28:41.796443 29490 tablet_replica.cc:330] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: stopping tablet replica
I20260806 19:28:41.796854 29490 raft_consensus.cc:2229] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:41.797097 29490 raft_consensus.cc:2258] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:41.798795 29490 ts_tablet_manager.cc:1905] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.800962 29492 ts_tablet_manager.cc:1905] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:41.804360 29491 ts_tablet_manager.cc:1918] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:41.804560 29491 log.cc:1196] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/3fbf68048b08421cabfd4e23601e0239
I20260806 19:28:41.805015 29491 ts_tablet_manager.cc:1939] T 3fbf68048b08421cabfd4e23601e0239 P cc95c663c01745d9838f93b5f6370209: Deleting consensus metadata
I20260806 19:28:41.806529 28654 catalog_manager.cc:4841] TS cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339): tablet 3fbf68048b08421cabfd4e23601e0239 (table test-table [id=2efd06dea05f4725b452c0cba6f61424]) successfully deleted
I20260806 19:28:41.826428 29492 ts_tablet_manager.cc:1918] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:41.827128 29490 ts_tablet_manager.cc:1918] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:41.827442 29492 log.cc:1196] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/3fbf68048b08421cabfd4e23601e0239
I20260806 19:28:41.827991 29492 ts_tablet_manager.cc:1939] T 3fbf68048b08421cabfd4e23601e0239 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting consensus metadata
I20260806 19:28:41.828212 29490 log.cc:1196] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/3fbf68048b08421cabfd4e23601e0239
I20260806 19:28:41.828733 29490 ts_tablet_manager.cc:1939] T 3fbf68048b08421cabfd4e23601e0239 P 25595b266285495fa579fb2df00f30d7: Deleting consensus metadata
I20260806 19:28:41.830154 28654 catalog_manager.cc:4841] TS d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697): tablet 3fbf68048b08421cabfd4e23601e0239 (table test-table [id=2efd06dea05f4725b452c0cba6f61424]) successfully deleted
I20260806 19:28:41.831580 28657 catalog_manager.cc:4841] TS 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143): tablet 3fbf68048b08421cabfd4e23601e0239 (table test-table [id=2efd06dea05f4725b452c0cba6f61424]) successfully deleted
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 19:28:41.898180 29262 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:41.882926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52692 (local address 127.17.18.126:42297)
0806 19:28:41.883124 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.883131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.883743 (+ 612us) server_negotiation.cc:407] Connection header received
0806 19:28:41.883951 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.883957 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.884073 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.884189 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:41.886068 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.887285 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.889341 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.890099 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.890261 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.897880 (+ 7619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52692: BlockingRecv error: recv got EOF from 127.0.0.1:52692 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 19:28:41 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM
I20260806 19:28:41.922287 29262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:41.902956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52698 (local address 127.17.18.126:42297)
0806 19:28:41.903154 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:41.903161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:41.903375 (+ 214us) server_negotiation.cc:407] Connection header received
0806 19:28:41.903659 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:41.903665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:41.903767 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:41.903888 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:41.905548 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.906716 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.908594 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:41.909298 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:41.909498 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:41.914883 (+ 5385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:41.914893 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:41.914898 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:41.914952 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:41.918847 (+ 3895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.919925 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.919931 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.919935 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.920124 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:41.920567 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:41.920572 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:41.920576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:41.920955 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:41.921242 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:41.921596 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 19:28:41.921890 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 19:28:41.926920 28673 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:41.927785 28673 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:41.936359 28906 tablet_service.cc:1467] Processing CreateTablet for tablet 55e6fc8e11474855ad43c65508e4d072 (DEFAULT_TABLE table=test-table [id=7b8a595c0fb84adea23572c64cae1ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.936940 28906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55e6fc8e11474855ad43c65508e4d072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.941923 29326 tablet_service.cc:1467] Processing CreateTablet for tablet 55e6fc8e11474855ad43c65508e4d072 (DEFAULT_TABLE table=test-table [id=7b8a595c0fb84adea23572c64cae1ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.942432 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55e6fc8e11474855ad43c65508e4d072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.942762 29103 tablet_service.cc:1467] Processing CreateTablet for tablet 55e6fc8e11474855ad43c65508e4d072 (DEFAULT_TABLE table=test-table [id=7b8a595c0fb84adea23572c64cae1ed0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:41.943228 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55e6fc8e11474855ad43c65508e4d072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:41.951450 29463 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Bootstrap starting.
I20260806 19:28:41.953852 29463 tablet_bootstrap.cc:654] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.955060 29459 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Bootstrap starting.
I20260806 19:28:41.956684 29463 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: No bootstrap required, opened a new log
I20260806 19:28:41.956790 29459 tablet_bootstrap.cc:654] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.956868 29463 ts_tablet_manager.cc:1397] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260806 19:28:41.959188 29463 raft_consensus.cc:348] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.959504 29463 raft_consensus.cc:374] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.959614 29463 raft_consensus.cc:729] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.959981 29463 consensus_queue.cc:260] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.964793 29463 ts_tablet_manager.cc:1428] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20260806 19:28:41.971256 29461 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Bootstrap starting.
I20260806 19:28:41.973243 29461 tablet_bootstrap.cc:654] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:41.980655 29459 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: No bootstrap required, opened a new log
I20260806 19:28:41.980847 29459 ts_tablet_manager.cc:1397] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.014s
I20260806 19:28:41.981779 29459 raft_consensus.cc:348] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.982070 29459 raft_consensus.cc:374] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.982168 29459 raft_consensus.cc:729] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc95c663c01745d9838f93b5f6370209, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.984519 29459 consensus_queue.cc:260] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.986788 29459 ts_tablet_manager.cc:1428] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260806 19:28:41.991133 29461 tablet_bootstrap.cc:492] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: No bootstrap required, opened a new log
I20260806 19:28:41.991351 29461 ts_tablet_manager.cc:1397] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.004s
I20260806 19:28:41.994464 29461 raft_consensus.cc:348] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.994765 29461 raft_consensus.cc:374] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:41.994889 29461 raft_consensus.cc:729] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Initialized, Role: FOLLOWER
I20260806 19:28:41.995308 29461 consensus_queue.cc:260] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:41.996280 29461 ts_tablet_manager.cc:1428] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260806 19:28:42.239569 29470 raft_consensus.cc:482] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:42.239840 29470 raft_consensus.cc:504] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.240790 29470 leader_election.cc:288] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:42.241614 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55e6fc8e11474855ad43c65508e4d072" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209" is_pre_election: true
I20260806 19:28:42.241710 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55e6fc8e11474855ad43c65508e4d072" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7" is_pre_election: true
I20260806 19:28:42.241964 28938 raft_consensus.cc:2454] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:42.242046 29353 raft_consensus.cc:2454] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:42.242786 29030 leader_election.cc:302] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc95c663c01745d9838f93b5f6370209, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:42.243180 29470 raft_consensus.cc:2781] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:42.243330 29470 raft_consensus.cc:482] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:42.243436 29470 raft_consensus.cc:3037] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.247098 29470 raft_consensus.cc:504] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.247892 29470 leader_election.cc:288] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Requested vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:42.248584 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55e6fc8e11474855ad43c65508e4d072" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209"
I20260806 19:28:42.248718 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55e6fc8e11474855ad43c65508e4d072" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7"
I20260806 19:28:42.248827 28938 raft_consensus.cc:3037] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.248948 29353 raft_consensus.cc:3037] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.251945 28938 raft_consensus.cc:2454] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:42.252022 29353 raft_consensus.cc:2454] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:42.252631 29033 leader_election.cc:302] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:42.253131 29470 raft_consensus.cc:2781] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:42.253412 29470 raft_consensus.cc:686] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Becoming Leader. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Running, Role: LEADER
I20260806 19:28:42.253774 29470 consensus_queue.cc:237] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.257510 28673 catalog_manager.cc:5495] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66). New cstate: current_term: 1 leader_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } health_report { overall_health: UNKNOWN } } }
I20260806 19:28:42.337743 29569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:42.332577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48786 (local address 127.17.18.66:45697)
0806 19:28:42.333018 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:42.333023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:42.333040 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:28:42.333106 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:42.333110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:42.333191 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:42.333281 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:28:42.333756 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.334482 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.335892 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.336323 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.336436 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:42.336984 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:28:42.337138 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:28:42.337221 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:42.337331 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 19:28:42.337450 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":244,"threads_started":1}
I20260806 19:28:42.341113 28938 raft_consensus.cc:1261] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:42.341113 29353 raft_consensus.cc:1261] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:42.341820 29470 consensus_queue.cc:1035] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:42.342109 29530 consensus_queue.cc:1035] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:42.363570 28673 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:42.363811 28673 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:42.366895 28673 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Sending DeleteTablet for 3 replicas of tablet 55e6fc8e11474855ad43c65508e4d072
I20260806 19:28:42.367866 28906 tablet_service.cc:1514] Processing DeleteTablet for tablet 55e6fc8e11474855ad43c65508e4d072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40532
I20260806 19:28:42.367977 29326 tablet_service.cc:1514] Processing DeleteTablet for tablet 55e6fc8e11474855ad43c65508e4d072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:53646
I20260806 19:28:42.368018 29103 tablet_service.cc:1514] Processing DeleteTablet for tablet 55e6fc8e11474855ad43c65508e4d072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48770
I20260806 19:28:42.369156 28673 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:28:42.370011 28673 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:28:42.371846 29586 tablet_replica.cc:330] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: stopping tablet replica
I20260806 19:28:42.372092 29587 tablet_replica.cc:330] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: stopping tablet replica
I20260806 19:28:42.372121 29586 raft_consensus.cc:2229] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:42.372321 29587 raft_consensus.cc:2229] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:42.372452 29586 raft_consensus.cc:2258] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.372836 29587 raft_consensus.cc:2258] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.374280 29587 ts_tablet_manager.cc:1905] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.374550 29586 ts_tablet_manager.cc:1905] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.379791 29326 tablet_service.cc:1467] Processing CreateTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 (DEFAULT_TABLE table=test-table [id=0a5ea09209674825bf87bddc7ca43996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:42.380326 29326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff75c52d04954ce889b403aeb2c77dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:42.381297 29585 tablet_replica.cc:330] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: stopping tablet replica
I20260806 19:28:42.381402 29587 ts_tablet_manager.cc:1918] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:42.381556 29587 log.cc:1196] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/55e6fc8e11474855ad43c65508e4d072
I20260806 19:28:42.381553 29585 raft_consensus.cc:2229] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:42.382032 29587 ts_tablet_manager.cc:1939] T 55e6fc8e11474855ad43c65508e4d072 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting consensus metadata
I20260806 19:28:42.382031 29585 raft_consensus.cc:2258] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.383472 28654 catalog_manager.cc:4841] TS d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697): tablet 55e6fc8e11474855ad43c65508e4d072 (table test-table [id=7b8a595c0fb84adea23572c64cae1ed0]) successfully deleted
I20260806 19:28:42.383857 29585 ts_tablet_manager.cc:1905] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.384001 28906 tablet_service.cc:1467] Processing CreateTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 (DEFAULT_TABLE table=test-table [id=0a5ea09209674825bf87bddc7ca43996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:42.384527 28906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff75c52d04954ce889b403aeb2c77dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:42.384531 29103 tablet_service.cc:1467] Processing CreateTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 (DEFAULT_TABLE table=test-table [id=0a5ea09209674825bf87bddc7ca43996]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:28:42.384967 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff75c52d04954ce889b403aeb2c77dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:42.389302 29585 ts_tablet_manager.cc:1918] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:42.389477 29585 log.cc:1196] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/55e6fc8e11474855ad43c65508e4d072
I20260806 19:28:42.389981 29585 ts_tablet_manager.cc:1939] T 55e6fc8e11474855ad43c65508e4d072 P cc95c663c01745d9838f93b5f6370209: Deleting consensus metadata
I20260806 19:28:42.391899 29459 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Bootstrap starting.
I20260806 19:28:42.392009 29463 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Bootstrap starting.
I20260806 19:28:42.393667 29459 tablet_bootstrap.cc:654] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:42.393675 29463 tablet_bootstrap.cc:654] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:42.393826 28654 catalog_manager.cc:4841] TS cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339): tablet 55e6fc8e11474855ad43c65508e4d072 (table test-table [id=7b8a595c0fb84adea23572c64cae1ed0]) successfully deleted
I20260806 19:28:42.396189 29461 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Bootstrap starting.
I20260806 19:28:42.398275 29461 tablet_bootstrap.cc:654] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:42.399947 29586 ts_tablet_manager.cc:1918] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:28:42.400131 29586 log.cc:1196] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/55e6fc8e11474855ad43c65508e4d072
I20260806 19:28:42.400641 29586 ts_tablet_manager.cc:1939] T 55e6fc8e11474855ad43c65508e4d072 P 25595b266285495fa579fb2df00f30d7: Deleting consensus metadata
I20260806 19:28:42.402042 28657 catalog_manager.cc:4841] TS 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143): tablet 55e6fc8e11474855ad43c65508e4d072 (table test-table [id=7b8a595c0fb84adea23572c64cae1ed0]) successfully deleted
I20260806 19:28:42.406450 29461 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: No bootstrap required, opened a new log
I20260806 19:28:42.406509 29463 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: No bootstrap required, opened a new log
I20260806 19:28:42.406592 29459 tablet_bootstrap.cc:492] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: No bootstrap required, opened a new log
I20260806 19:28:42.406742 29463 ts_tablet_manager.cc:1397] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.002s
I20260806 19:28:42.406790 29461 ts_tablet_manager.cc:1397] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20260806 19:28:42.406854 29459 ts_tablet_manager.cc:1397] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260806 19:28:42.407647 29463 raft_consensus.cc:348] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.407752 29461 raft_consensus.cc:348] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.407754 29459 raft_consensus.cc:348] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.408010 29463 raft_consensus.cc:374] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:42.408084 29461 raft_consensus.cc:374] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:42.408131 29459 raft_consensus.cc:374] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:42.408140 29463 raft_consensus.cc:729] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25595b266285495fa579fb2df00f30d7, State: Initialized, Role: FOLLOWER
I20260806 19:28:42.408228 29461 raft_consensus.cc:729] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Initialized, Role: FOLLOWER
I20260806 19:28:42.408275 29459 raft_consensus.cc:729] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc95c663c01745d9838f93b5f6370209, State: Initialized, Role: FOLLOWER
I20260806 19:28:42.408435 29463 consensus_queue.cc:260] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.408561 29461 consensus_queue.cc:260] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.408617 29459 consensus_queue.cc:260] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.409224 29461 ts_tablet_manager.cc:1428] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 19:28:42.409772 29463 ts_tablet_manager.cc:1428] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260806 19:28:42.410388 29459 ts_tablet_manager.cc:1428] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260806 19:28:42.527245 29582 raft_consensus.cc:482] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:28:42.527470 29582 raft_consensus.cc:504] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.528334 29582 leader_election.cc:288] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:42.528884 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff75c52d04954ce889b403aeb2c77dc3" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209" is_pre_election: true
I20260806 19:28:42.528946 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff75c52d04954ce889b403aeb2c77dc3" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7" is_pre_election: true
I20260806 19:28:42.529132 28938 raft_consensus.cc:2454] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:42.529206 29353 raft_consensus.cc:2454] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 0.
I20260806 19:28:42.529604 29030 leader_election.cc:302] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc95c663c01745d9838f93b5f6370209, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:42.529942 29582 raft_consensus.cc:2781] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:28:42.530077 29582 raft_consensus.cc:482] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:28:42.530184 29582 raft_consensus.cc:3037] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.532289 29582 raft_consensus.cc:504] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.532919 29582 leader_election.cc:288] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Requested vote from peers cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339), 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143)
I20260806 19:28:42.533540 28938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff75c52d04954ce889b403aeb2c77dc3" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc95c663c01745d9838f93b5f6370209"
I20260806 19:28:42.533625 29353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff75c52d04954ce889b403aeb2c77dc3" candidate_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25595b266285495fa579fb2df00f30d7"
I20260806 19:28:42.533775 28938 raft_consensus.cc:3037] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.533854 29353 raft_consensus.cc:3037] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:42.535880 28938 raft_consensus.cc:2454] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:42.535884 29353 raft_consensus.cc:2454] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9a62e2a80f94055a7a2529dbedbc62b in term 1.
I20260806 19:28:42.536381 29030 leader_election.cc:302] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 25595b266285495fa579fb2df00f30d7, cc95c663c01745d9838f93b5f6370209, d9a62e2a80f94055a7a2529dbedbc62b; no voters:
I20260806 19:28:42.536692 29582 raft_consensus.cc:2781] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:42.536823 29582 raft_consensus.cc:686] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Becoming Leader. State: Replica: d9a62e2a80f94055a7a2529dbedbc62b, State: Running, Role: LEADER
I20260806 19:28:42.537086 29582 consensus_queue.cc:237] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } }
I20260806 19:28:42.539856 28675 catalog_manager.cc:5495] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66). New cstate: current_term: 1 leader_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9a62e2a80f94055a7a2529dbedbc62b" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 } health_report { overall_health: UNKNOWN } } }
I20260806 19:28:42.578040 29353 raft_consensus.cc:1261] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:42.578174 28938 raft_consensus.cc:1261] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Refusing update from remote peer d9a62e2a80f94055a7a2529dbedbc62b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:28:42.578662 29530 consensus_queue.cc:1035] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "25595b266285495fa579fb2df00f30d7" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 37143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:42.578969 29582 consensus_queue.cc:1035] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc95c663c01745d9838f93b5f6370209" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:28:42.634763 28673 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:42.635030 28673 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:28:42.638276 28673 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55451ca2740e4892ae1a3c207f2031bf: Sending DeleteTablet for 3 replicas of tablet ff75c52d04954ce889b403aeb2c77dc3
I20260806 19:28:42.639240 28906 tablet_service.cc:1514] Processing DeleteTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40532
I20260806 19:28:42.639344 29103 tablet_service.cc:1514] Processing DeleteTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48770
I20260806 19:28:42.639459 29326 tablet_service.cc:1514] Processing DeleteTablet for tablet ff75c52d04954ce889b403aeb2c77dc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:28:42 UTC) from {username='oryx', principal='oryx/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:53646
I20260806 19:28:42.639597 29585 tablet_replica.cc:330] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: stopping tablet replica
I20260806 19:28:42.639658 29587 tablet_replica.cc:330] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: stopping tablet replica
I20260806 19:28:42.639736 29586 tablet_replica.cc:330] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: stopping tablet replica
I20260806 19:28:42.639806 29585 raft_consensus.cc:2229] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:42.639871 29587 raft_consensus.cc:2229] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:28:42.639931 29586 raft_consensus.cc:2229] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:28:42.640018 29585 raft_consensus.cc:2258] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.640136 29586 raft_consensus.cc:2258] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.640209 29587 raft_consensus.cc:2258] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:28:42.641182 29585 ts_tablet_manager.cc:1905] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.641223 29587 ts_tablet_manager.cc:1905] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.641513 29586 ts_tablet_manager.cc:1905] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:28:42.645869 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 28810
I20260806 19:28:42.648995 29585 ts_tablet_manager.cc:1918] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:42.649398 29585 log.cc:1196] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/ff75c52d04954ce889b403aeb2c77dc3
I20260806 19:28:42.649986 29585 ts_tablet_manager.cc:1939] T ff75c52d04954ce889b403aeb2c77dc3 P cc95c663c01745d9838f93b5f6370209: Deleting consensus metadata
I20260806 19:28:42.650050 29586 ts_tablet_manager.cc:1918] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:42.650323 29586 log.cc:1196] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/ff75c52d04954ce889b403aeb2c77dc3
I20260806 19:28:42.650327 29587 ts_tablet_manager.cc:1918] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 19:28:42.650875 29586 ts_tablet_manager.cc:1939] T ff75c52d04954ce889b403aeb2c77dc3 P 25595b266285495fa579fb2df00f30d7: Deleting consensus metadata
I20260806 19:28:42.650931 29587 log.cc:1196] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/ff75c52d04954ce889b403aeb2c77dc3
I20260806 19:28:42.651389 28654 catalog_manager.cc:4841] TS cc95c663c01745d9838f93b5f6370209 (127.17.18.65:40339): tablet ff75c52d04954ce889b403aeb2c77dc3 (table test-table [id=0a5ea09209674825bf87bddc7ca43996]) successfully deleted
I20260806 19:28:42.652064 29587 ts_tablet_manager.cc:1939] T ff75c52d04954ce889b403aeb2c77dc3 P d9a62e2a80f94055a7a2529dbedbc62b: Deleting consensus metadata
I20260806 19:28:42.652554 28657 catalog_manager.cc:4841] TS 25595b266285495fa579fb2df00f30d7 (127.17.18.67:37143): tablet ff75c52d04954ce889b403aeb2c77dc3 (table test-table [id=0a5ea09209674825bf87bddc7ca43996]) successfully deleted
I20260806 19:28:42.653218 28654 catalog_manager.cc:4841] TS d9a62e2a80f94055a7a2529dbedbc62b (127.17.18.66:45697): tablet ff75c52d04954ce889b403aeb2c77dc3 (table test-table [id=0a5ea09209674825bf87bddc7ca43996]) successfully deleted
Aug 06 19:28:42 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.65@KRBTEST.COM
I20260806 19:28:42.667092 29601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:42.647144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40544 (local address 127.17.18.65:40339)
0806 19:28:42.651768 (+ 4624us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:42.651774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:42.652051 (+ 277us) server_negotiation.cc:407] Connection header received
0806 19:28:42.652277 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:42.652281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:42.652353 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:42.652468 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:42.653970 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.654770 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.656129 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.656618 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.656724 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:42.660901 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:42.660924 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:42.660945 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:42.660992 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:42.664134 (+ 3142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.664968 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.664977 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.664979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.665147 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.665623 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.665627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.665629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.666040 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:42.666287 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:42.666577 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 19:28:42.666812 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4470,"thread_start_us":4340,"threads_started":1}
I20260806 19:28:42.667877 28995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:42.768752 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 28810
I20260806 19:28:42.798806 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 29008
Aug 06 19:28:42 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.66@KRBTEST.COM
I20260806 19:28:42.815506 29569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:42.799578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48802 (local address 127.17.18.66:45697)
0806 19:28:42.799748 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:42.799754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:42.799777 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:28:42.799973 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:42.799978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:42.800049 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:42.800158 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:42.801656 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.802450 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.803869 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.804454 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.804589 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:42.809129 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:42.809150 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:42.809192 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:42.809238 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:42.812445 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.813271 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.813281 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.813283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.813486 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.813861 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.813865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.813868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.814294 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:42.814609 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:42.814992 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 19:28:42.815233 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:28:42.816257 29219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:42.944629 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 29008
I20260806 19:28:42.982486 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 29232
Aug 06 19:28:42 dist-test-slave-f0tn krb5kdc[28612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.18.67@KRBTEST.COM
I20260806 19:28:43.001302 29606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:42.983287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53686 (local address 127.17.18.67:37143)
0806 19:28:42.983827 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:42.983832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:42.983847 (+ 15us) server_negotiation.cc:407] Connection header received
0806 19:28:42.983906 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:42.983910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:42.983972 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:42.984085 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:42.985441 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.986165 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.987448 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:42.987894 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:42.988024 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:42.993043 (+ 5019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:42.993061 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:42.993082 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:42.993125 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:42.997238 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.998527 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.998539 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.998542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.998755 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:42.999291 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:42.999296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:42.999298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:42.999794 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:43.000143 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:43.000623 (+ 480us) server_negotiation.cc:299] Negotiation successful
0806 19:28:43.000907 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":289,"threads_started":1}
I20260806 19:28:43.002405 29417 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:43.151039 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 29232
I20260806 19:28:43.189110 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 28631
I20260806 19:28:43.190554 28738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:43.312845 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 28631
2026-08-06T19:28:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7397 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:43 dist-test-slave-f0tn krb5kdc[29613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:43 dist-test-slave-f0tn krb5kdc[29613](info): set up 2 sockets
Aug 06 19:28:43 dist-test-slave-f0tn krb5kdc[29613](info): commencing operation
krb5kdc: starting...
W20260806 19:28:44.553274 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:44 dist-test-slave-f0tn krb5kdc[29613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:28:44.857497 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40919
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:36385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:45.223079 29636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:45.223444 29636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:45.223579 29636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:45.231307 29636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:45.231463 29636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:45.231557 29636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:45.231645 29636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:45.231719 29636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:45.242882 29636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:36385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:45.244395 29636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:45.246191 29636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:45.259399 29646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:45.259557 29648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:45.259593 29645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:45.260607 29636 server_base.cc:1034] running on GCE node
I20260806 19:28:45.261644 29636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:45.263357 29636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:45.264642 29636 hybrid_clock.cc:648] HybridClock initialized: now 1786044525264567 us; error 53 us; skew 500 ppm
I20260806 19:28:45.265102 29636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T19:28:45Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2018 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:28:45 dist-test-slave-f0tn krb5kdc[29658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:28:45 dist-test-slave-f0tn krb5kdc[29658](info): set up 2 sockets
Aug 06 19:28:45 dist-test-slave-f0tn krb5kdc[29658](info): commencing operation
krb5kdc: starting...
W20260806 19:28:46.570430 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:28:46 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:28:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:28:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:28:46.873929 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40155
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:47.237272 29674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:47.237726 29674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:47.237881 29674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:47.247125 29674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:47.247298 29674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:47.247386 29674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:47.247473 29674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:47.247540 29674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:47.259020 29674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:47.260574 29674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:47.262205 29674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:47.275503 29681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:47.275425 29684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:47.275429 29682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:47.276381 29674 server_base.cc:1034] running on GCE node
I20260806 19:28:47.277253 29674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:47.278975 29674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:47.280445 29674 hybrid_clock.cc:648] HybridClock initialized: now 1786044527280299 us; error 49 us; skew 500 ppm
I20260806 19:28:47.281255 29674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:47 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044527, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:47.298008 29674 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:28:47.300060 29674 webserver.cc:460] Webserver started at http://127.17.18.126:36695/ using document root <none> and password file <none>
I20260806 19:28:47.300841 29674 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:47.300958 29674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:47.301277 29674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:47.304657 29674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "aa675aab04ba4d92a82a8d835fafee9d"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "2a7510e87af156fea5d503c2fdf8c475"
server_key_iv: "aa58a8c0a972c9027ef9ed952131f91b"
server_key_version: "encryptionkey@0"
I20260806 19:28:47.305576 29674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "aa675aab04ba4d92a82a8d835fafee9d"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "2a7510e87af156fea5d503c2fdf8c475"
server_key_iv: "aa58a8c0a972c9027ef9ed952131f91b"
server_key_version: "encryptionkey@0"
I20260806 19:28:47.311595 29674 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:28:47.315650 29696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:47.317548 29674 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:47.317754 29674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "aa675aab04ba4d92a82a8d835fafee9d"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "2a7510e87af156fea5d503c2fdf8c475"
server_key_iv: "aa58a8c0a972c9027ef9ed952131f91b"
server_key_version: "encryptionkey@0"
I20260806 19:28:47.318017 29674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:47.341733 29674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:47.346792 29674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:47.347126 29674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:47.367461 29674 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40155
I20260806 19:28:47.367515 29776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40155 every 8 connection(s)
I20260806 19:28:47.368938 29674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:47.373186 29778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:28:47.374614 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 29674
I20260806 19:28:47.374845 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:28:47.375509 17481 external_mini_cluster.cc:1428] Setting key 005f3ac250db7cd48fff29e8d7d2ee5f
I20260806 19:28:47.389243 29778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Bootstrap starting.
Aug 06 19:28:47 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:47.392903 29778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Neither blocks nor log segments found. Creating new log.
I20260806 19:28:47.394563 29778 log.cc:824] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:47.398584 29778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: No bootstrap required, opened a new log
I20260806 19:28:47.403156 29783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:47.377755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57132 (local address 127.17.18.126:40155)
0806 19:28:47.378685 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:47.378702 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:47.378758 (+ 56us) server_negotiation.cc:407] Connection header received
0806 19:28:47.380600 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:47.380644 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:47.381297 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:47.381883 (+ 586us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:47.383547 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:47.385664 (+ 2117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:47.387174 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:47.388289 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:47.388528 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:47.393182 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:47.393196 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:47.393220 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:47.393293 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:47.397362 (+ 4069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:47.398310 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:47.398320 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:47.398330 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:47.398588 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:47.399054 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:47.399060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:47.399063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:47.399872 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:47.400210 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:47.400738 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 19:28:47.401528 (+ 790us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":375,"threads_started":1}
I20260806 19:28:47.409564 29778 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:47.410066 29778 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:28:47.410178 29778 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa675aab04ba4d92a82a8d835fafee9d, State: Initialized, Role: FOLLOWER
I20260806 19:28:47.410858 29778 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:47.411109 29778 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:47.411271 29778 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:47.411444 29778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:28:47.414244 29778 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:47.414830 29778 leader_election.cc:302] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa675aab04ba4d92a82a8d835fafee9d; no voters:
I20260806 19:28:47.415501 29778 leader_election.cc:288] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:28:47.415763 29785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:28:47.416591 29785 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 LEADER]: Becoming Leader. State: Replica: aa675aab04ba4d92a82a8d835fafee9d, State: Running, Role: LEADER
I20260806 19:28:47.417187 29785 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:47.417802 29778 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:47.420307 29786 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa675aab04ba4d92a82a8d835fafee9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } } }
I20260806 19:28:47.420811 29786 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:47.420331 29788 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa675aab04ba4d92a82a8d835fafee9d. Latest consensus state: current_term: 1 leader_uuid: "aa675aab04ba4d92a82a8d835fafee9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } } }
I20260806 19:28:47.422587 29788 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:47.424171 29793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:47.429993 29793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:47.440131 29793 catalog_manager.cc:1347] Generated new cluster ID: 77dc1e878fa04462bd3b15c7548a6909
I20260806 19:28:47.440287 29793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:47.465847 29793 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:28:47.467355 29793 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:47.487573 29793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Generated new TSK 0
I20260806 19:28:47.488775 29793 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:28:47.582355 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:47.955022 29826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:47.955340 29826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:47.955439 29826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:47.963105 29826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:47.963244 29826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:47.963363 29826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:47.973687 29826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:47.975080 29826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:47.976446 29826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:47.991544 29833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:47.991482 29832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:47.991590 29837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:47.992460 29826 server_base.cc:1034] running on GCE node
I20260806 19:28:47.993338 29826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:47.994570 29826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:47.995818 29826 hybrid_clock.cc:648] HybridClock initialized: now 1786044527995754 us; error 60 us; skew 500 ppm
I20260806 19:28:47.996183 29826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:47 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044527, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:47.999859 29826 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:28:48.002213 29826 webserver.cc:460] Webserver started at http://127.17.18.65:42661/ using document root <none> and password file <none>
I20260806 19:28:48.003031 29826 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:48.003187 29826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:48.003536 29826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:48.006927 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "b71f73fcc70c4f66a78424f42ed0db10"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "9c67ac33113e45d78256a7180c7ab899"
server_key_iv: "bc520b1b24bf536a050c07b82a1a9217"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.007849 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "b71f73fcc70c4f66a78424f42ed0db10"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "9c67ac33113e45d78256a7180c7ab899"
server_key_iv: "bc520b1b24bf536a050c07b82a1a9217"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.014765 29826 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 19:28:48.018793 29853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.020613 29826 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:48.020848 29826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "b71f73fcc70c4f66a78424f42ed0db10"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "9c67ac33113e45d78256a7180c7ab899"
server_key_iv: "bc520b1b24bf536a050c07b82a1a9217"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.021106 29826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:48.058317 29826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:48.063444 29826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:48.063792 29826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:48.064946 29826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:48.066583 29826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:48.066682 29826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.066834 29826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:48.066895 29826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.101881 29826 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:39547
I20260806 19:28:48.101913 30030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:39547 every 8 connection(s)
I20260806 19:28:48.103319 29826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:48.104072 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 29826
I20260806 19:28:48.104311 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:28:48.105119 17481 external_mini_cluster.cc:1428] Setting key b64d86193b146ffda87c8d32265092b3
Aug 06 19:28:48 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044527, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:48.127362 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:48.106464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:54411 (local address 127.17.18.126:40155)
0806 19:28:48.106982 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:48.106987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:48.108315 (+ 1328us) server_negotiation.cc:407] Connection header received
0806 19:28:48.110318 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:48.110324 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:48.110419 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:48.110541 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:48.112193 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.113165 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.115004 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.115573 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.115704 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:48.120122 (+ 4418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:48.120128 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:48.120131 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:48.120170 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:48.123175 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:48.124405 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:48.124410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:48.124412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:48.124557 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:48.125173 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:48.125178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:48.125181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:48.125579 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:48.125744 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:48.126687 (+ 943us) server_negotiation.cc:299] Negotiation successful
0806 19:28:48.126952 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":279,"threads_started":1}
I20260806 19:28:48.128455 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:48.107190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:54411)
0806 19:28:48.108100 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:48.108151 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:48.110025 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:48.110769 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:48.110778 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:48.111349 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:48.112003 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:48.112026 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.113442 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.113449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:48.114831 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:48.114847 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.115823 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.115829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:48.116060 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:48.116776 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:48.116809 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:48.119744 (+ 2935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:48.123402 (+ 3658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:48.123431 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:48.123453 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:48.124233 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:48.124677 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:48.124682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:48.124685 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:48.124966 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:48.125735 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:48.125744 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:48.126202 (+ 458us) client_negotiation.cc:769] Sending connection context
0806 19:28:48.126529 (+ 327us) client_negotiation.cc:240] Negotiation successful
0806 19:28:48.127167 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":362,"threads_started":1}
I20260806 19:28:48.130548 30031 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40155
I20260806 19:28:48.130892 30031 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:48.131771 30031 heartbeater.cc:511] Master 127.17.18.126:40155 requested a full tablet report, sending...
I20260806 19:28:48.134580 29724 ts_manager.cc:194] Registered new tserver with Master: b71f73fcc70c4f66a78424f42ed0db10 (127.17.18.65:39547)
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:28:48.136417 29724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:54411
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:28:48.173861 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:48.539851 30037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:48.540190 30037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:48.540325 30037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:48.548053 30037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:48.548219 30037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:48.548388 30037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:48.559214 30037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:48.560622 30037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:48.562155 30037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:48.576606 30046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:48.576664 30047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:48.576702 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:48.577345 30037 server_base.cc:1034] running on GCE node
I20260806 19:28:48.578118 30037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:48.579182 30037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:48.580431 30037 hybrid_clock.cc:648] HybridClock initialized: now 1786044528580364 us; error 49 us; skew 500 ppm
I20260806 19:28:48.580797 30037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:48 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044528, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:48.584296 30037 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:28:48.586113 30037 webserver.cc:460] Webserver started at http://127.17.18.66:43387/ using document root <none> and password file <none>
I20260806 19:28:48.586866 30037 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:48.586993 30037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:48.587323 30037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:48.590562 30037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "1da52717c06645a3b94159dd63672d64"
format_stamp: "Formatted at 2026-08-06 19:28:48 on dist-test-slave-f0tn"
server_key: "4a1d67cd174af6725166528cac46601c"
server_key_iv: "cccaa12b449f05004e732c605e42fc6b"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.591449 30037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "1da52717c06645a3b94159dd63672d64"
format_stamp: "Formatted at 2026-08-06 19:28:48 on dist-test-slave-f0tn"
server_key: "4a1d67cd174af6725166528cac46601c"
server_key_iv: "cccaa12b449f05004e732c605e42fc6b"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.597805 30037 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:28:48.602012 30065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.603826 30037 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:28:48.604041 30037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "1da52717c06645a3b94159dd63672d64"
format_stamp: "Formatted at 2026-08-06 19:28:48 on dist-test-slave-f0tn"
server_key: "4a1d67cd174af6725166528cac46601c"
server_key_iv: "cccaa12b449f05004e732c605e42fc6b"
server_key_version: "encryptionkey@0"
I20260806 19:28:48.604281 30037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:48.623975 30037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:48.629225 30037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:48.629583 30037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:48.630658 30037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:48.632158 30037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:48.632238 30037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.632334 30037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:48.632378 30037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:48.663849 30037 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:38613
I20260806 19:28:48.663887 30223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:38613 every 8 connection(s)
I20260806 19:28:48.665259 30037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:48.673835 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30037
I20260806 19:28:48.674026 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:28:48.674482 17481 external_mini_cluster.cc:1428] Setting key 60374de73d60dc587b4c78a6866c4a36
Aug 06 19:28:48 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044528, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:48.687253 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:48.668069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:50875 (local address 127.17.18.126:40155)
0806 19:28:48.668529 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:48.668535 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:48.669558 (+ 1023us) server_negotiation.cc:407] Connection header received
0806 19:28:48.671575 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:48.671582 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:48.671684 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:48.671793 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:48.673769 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.674597 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.676569 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.677030 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.677148 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:48.681110 (+ 3962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:48.681116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:48.681119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:48.681156 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:48.683883 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:48.684714 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:48.684718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:48.684721 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:48.684851 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:48.685338 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:48.685341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:48.685344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:48.685687 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:48.685836 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:48.686623 (+ 787us) server_negotiation.cc:299] Negotiation successful
0806 19:28:48.686875 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":244,"threads_started":1}
I20260806 19:28:48.688416 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:48.668498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:50875)
0806 19:28:48.669324 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:48.669367 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:48.671239 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:48.672091 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:48.672101 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:48.672835 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:48.673561 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:48.673584 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.674777 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.674781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:48.676410 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:48.676426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:48.677309 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:48.677318 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:48.677628 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:48.678349 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:48.678380 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:48.680830 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:48.684058 (+ 3228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:48.684070 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:48.684089 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:48.684561 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:48.684974 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:48.684980 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:48.684984 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:48.685203 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:48.685834 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:48.685843 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:48.686230 (+ 387us) client_negotiation.cc:769] Sending connection context
0806 19:28:48.686494 (+ 264us) client_negotiation.cc:240] Negotiation successful
0806 19:28:48.687097 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":328,"threads_started":1}
I20260806 19:28:48.690104 30224 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40155
I20260806 19:28:48.690464 30224 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:48.691468 30224 heartbeater.cc:511] Master 127.17.18.126:40155 requested a full tablet report, sending...
I20260806 19:28:48.693481 29724 ts_manager.cc:194] Registered new tserver with Master: 1da52717c06645a3b94159dd63672d64 (127.17.18.66:38613)
I20260806 19:28:48.694550 29724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:50875
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:28:48.744441 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:49.099547 30232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:49.099865 30232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:49.099963 30232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:49.107748 30232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:49.107884 30232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:49.108095 30232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:49.118577 30232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:49.120016 30232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:49.121492 30232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:49.135849 30241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:49.135898 30242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:49.135944 30246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:49.136626 30232 server_base.cc:1034] running on GCE node
I20260806 19:28:49.137319 30232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:49.138406 30232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:49.139634 30232 hybrid_clock.cc:648] HybridClock initialized: now 1786044529139569 us; error 56 us; skew 500 ppm
I20260806 19:28:49.140004 30232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:28:49.140314 30031 heartbeater.cc:503] Master 127.17.18.126:40155 was elected leader, sending a full tablet report...
Aug 06 19:28:49 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044529, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:49.143785 30232 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:28:49.145635 30232 webserver.cc:460] Webserver started at http://127.17.18.67:45977/ using document root <none> and password file <none>
I20260806 19:28:49.146409 30232 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:49.146528 30232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:49.146862 30232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:28:49.150367 30232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "e96b9bffdf874e0099b84112a2bbb043"
format_stamp: "Formatted at 2026-08-06 19:28:49 on dist-test-slave-f0tn"
server_key: "71c1e960a1617ab5a58a0ee4cab19585"
server_key_iv: "268a7baeee849945f4c5a0b2bfafe43a"
server_key_version: "encryptionkey@0"
I20260806 19:28:49.151364 30232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "e96b9bffdf874e0099b84112a2bbb043"
format_stamp: "Formatted at 2026-08-06 19:28:49 on dist-test-slave-f0tn"
server_key: "71c1e960a1617ab5a58a0ee4cab19585"
server_key_iv: "268a7baeee849945f4c5a0b2bfafe43a"
server_key_version: "encryptionkey@0"
I20260806 19:28:49.157507 30232 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260806 19:28:49.161507 30254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:49.163197 30232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 19:28:49.163398 30232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "e96b9bffdf874e0099b84112a2bbb043"
format_stamp: "Formatted at 2026-08-06 19:28:49 on dist-test-slave-f0tn"
server_key: "71c1e960a1617ab5a58a0ee4cab19585"
server_key_iv: "268a7baeee849945f4c5a0b2bfafe43a"
server_key_version: "encryptionkey@0"
I20260806 19:28:49.163625 30232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:49.179766 30232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:49.184353 30232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:49.184656 30232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:49.185786 30232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:49.187276 30232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:49.187359 30232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:49.187485 30232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:49.187541 30232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:49.220537 30232 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44537
I20260806 19:28:49.220638 30414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44537 every 8 connection(s)
I20260806 19:28:49.222035 30232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:49.225201 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30232
I20260806 19:28:49.225443 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:28:49.225984 17481 external_mini_cluster.cc:1428] Setting key 5bebc34a8b4b509f8fa024cee09bbfaf
Aug 06 19:28:49 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044529, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:28:49.244086 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:49.224974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:53457 (local address 127.17.18.126:40155)
0806 19:28:49.225602 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:49.225608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:49.227084 (+ 1476us) server_negotiation.cc:407] Connection header received
0806 19:28:49.229177 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:49.229184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:49.229281 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:49.229401 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:49.231175 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.231959 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.233683 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.234095 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.234235 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:49.238015 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:49.238021 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:49.238024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:49.238070 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:49.240746 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.241573 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.241577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.241579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.241728 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.242209 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.242213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.242215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.242502 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:49.242646 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:49.243436 (+ 790us) server_negotiation.cc:299] Negotiation successful
0806 19:28:49.243702 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":267,"threads_started":1}
I20260806 19:28:49.245184 30422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:49.225658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:53457)
0806 19:28:49.226592 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:49.226674 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:49.228830 (+ 2156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:49.229705 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:49.229714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:49.230311 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:49.230957 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:49.230976 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.232140 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.232144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:49.233517 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:49.233531 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.234373 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.234382 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:49.234654 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:49.235367 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:49.235392 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:49.237742 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:28:49.240902 (+ 3160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:49.240913 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:49.240932 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:49.241439 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:49.241849 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:28:49.241855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:28:49.241859 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:28:49.242081 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:28:49.242650 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:28:49.242660 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:28:49.243040 (+ 380us) client_negotiation.cc:769] Sending connection context
0806 19:28:49.243309 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 19:28:49.243910 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":335,"threads_started":1}
I20260806 19:28:49.246971 30417 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40155
I20260806 19:28:49.247293 30417 heartbeater.cc:464] Registering TS with master...
I20260806 19:28:49.248083 30417 heartbeater.cc:511] Master 127.17.18.126:40155 requested a full tablet report, sending...
I20260806 19:28:49.249771 29724 ts_manager.cc:194] Registered new tserver with Master: e96b9bffdf874e0099b84112a2bbb043 (127.17.18.67:44537)
I20260806 19:28:49.250612 29724 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:53457
I20260806 19:28:49.254765 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
Entry for principal oryx/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab.
WARNING: no policy specified for oryx/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
Entry for principal oryx/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab.
WARNING: no policy specified for oryx/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
Entry for principal oryx/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab.
I20260806 19:28:49.448546 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 29826
Aug 06 19:28:49 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:28:49.465804 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:49.449920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.17.18.65:39547)
0806 19:28:49.450637 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:49.450644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:49.450672 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:28:49.450739 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:49.450747 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:49.450981 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:49.451112 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:49.452507 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.453594 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.454890 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.455525 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.455637 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:49.459894 (+ 4257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:49.459910 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:49.459928 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:49.459967 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:49.462921 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.463670 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.463679 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.463681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.463827 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.464299 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.464303 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.464305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.464713 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:49.464992 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:49.465223 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 19:28:49.465505 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":364,"threads_started":1}
I20260806 19:28:49.467207 30024 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:49.554975 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 29826
I20260806 19:28:49.582684 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30037
Aug 06 19:28:49 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:28:49.601199 30433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:49.583709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49008 (local address 127.17.18.66:38613)
0806 19:28:49.584263 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:49.584270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:49.584297 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:28:49.584368 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:49.584375 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:49.584592 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:49.584731 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:49.586176 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.587269 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.588697 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.589334 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.589583 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:49.594350 (+ 4767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:49.594371 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:49.594392 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:49.594439 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:49.597675 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.598725 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.598736 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.598738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.598909 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.599369 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.599374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.599377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.599901 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:49.600231 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:49.600533 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 19:28:49.600779 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":278,"threads_started":1}
I20260806 19:28:49.602749 30219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:49.693818 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30037
I20260806 19:28:49.717038 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30232
Aug 06 19:28:49 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:28:49.735424 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:49.718154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50338 (local address 127.17.18.67:44537)
0806 19:28:49.718783 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:49.718790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:49.718822 (+ 32us) server_negotiation.cc:407] Connection header received
0806 19:28:49.718885 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:49.718892 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:49.719112 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:49.719280 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:49.720674 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.721795 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.723220 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:49.723823 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:49.723970 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:49.728778 (+ 4808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:49.728796 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:49.728816 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:49.728863 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:49.732050 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.732884 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.732893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.732895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.733045 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:49.733534 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:49.733539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:49.733541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:49.733969 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:49.734292 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:49.734681 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 19:28:49.734987 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":288,"threads_started":1}
I20260806 19:28:49.736900 30408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:49.821971 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30232
I20260806 19:28:49.845849 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 29674
I20260806 19:28:49.847306 29771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:28:49.955767 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 29674
I20260806 19:28:49.986511 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40155
--webserver_interface=127.17.18.126
--webserver_port=36695
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:28:50.375413 30438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:50.375779 30438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:50.375909 30438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:50.383740 30438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:28:50.383895 30438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:50.383973 30438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:50.384055 30438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:28:50.384120 30438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:28:50.395033 30438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=36695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:50.396581 30438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:50.398072 30438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:50.411038 30451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:50.411105 30445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:50.411075 30458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:50.411878 30438 server_base.cc:1034] running on GCE node
I20260806 19:28:50.412727 30438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:50.414588 30438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:50.415849 30438 hybrid_clock.cc:648] HybridClock initialized: now 1786044530415795 us; error 42 us; skew 500 ppm
I20260806 19:28:50.416273 30438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:50 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044530, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:50.419874 30438 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:28:50.421752 30438 webserver.cc:460] Webserver started at http://127.17.18.126:36695/ using document root <none> and password file <none>
I20260806 19:28:50.422555 30438 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:50.422720 30438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:50.428956 30438 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 19:28:50.432231 30471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:50.433873 30438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:28:50.434073 30438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "aa675aab04ba4d92a82a8d835fafee9d"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "2a7510e87af156fea5d503c2fdf8c475"
server_key_iv: "aa58a8c0a972c9027ef9ed952131f91b"
server_key_version: "encryptionkey@0"
I20260806 19:28:50.435166 30438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:50.467958 30438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:50.472612 30438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:50.472900 30438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:50.492911 30438 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40155
I20260806 19:28:50.492930 30542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40155 every 8 connection(s)
I20260806 19:28:50.494601 30438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:28:50.500654 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30438
I20260806 19:28:50.501838 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:39547
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:40155
--webserver_port=42661
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:28:50.503327 30543 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:28:50.508203 30543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Bootstrap starting.
I20260806 19:28:50.531915 30543 log.cc:824] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:28:50.542869 30543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:28:50.543605 30543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Bootstrap complete.
I20260806 19:28:50.553995 30543 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:50.554970 30543 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa675aab04ba4d92a82a8d835fafee9d, State: Initialized, Role: FOLLOWER
I20260806 19:28:50.555709 30543 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:50.555959 30543 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:28:50.556095 30543 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:28:50.556283 30543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 1 FOLLOWER]: Advancing to term 2
I20260806 19:28:50.560979 30543 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:50.561599 30543 leader_election.cc:302] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa675aab04ba4d92a82a8d835fafee9d; no voters:
I20260806 19:28:50.562292 30543 leader_election.cc:288] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 19:28:50.562453 30548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 2 FOLLOWER]: Leader election won for term 2
I20260806 19:28:50.564761 30543 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:28:50.569708 30548 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [term 2 LEADER]: Becoming Leader. State: Replica: aa675aab04ba4d92a82a8d835fafee9d, State: Running, Role: LEADER
I20260806 19:28:50.570488 30548 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } }
I20260806 19:28:50.573400 30550 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aa675aab04ba4d92a82a8d835fafee9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } } }
I20260806 19:28:50.573933 30550 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:50.574499 30551 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa675aab04ba4d92a82a8d835fafee9d. Latest consensus state: current_term: 2 leader_uuid: "aa675aab04ba4d92a82a8d835fafee9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa675aab04ba4d92a82a8d835fafee9d" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40155 } } }
I20260806 19:28:50.574808 30551 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d [sys.catalog]: This master's current role is: LEADER
I20260806 19:28:50.576977 30563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:28:50.590561 30563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:28:50.592417 30563 catalog_manager.cc:1259] Loaded cluster ID: 77dc1e878fa04462bd3b15c7548a6909
I20260806 19:28:50.592568 30563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:28:50.597339 30563 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:28:50.599756 30563 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aa675aab04ba4d92a82a8d835fafee9d: Loaded TSK: 0
I20260806 19:28:50.601792 30563 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:28:50.909044 30546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:50.909426 30546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:50.909590 30546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:50.918222 30546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:50.918370 30546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:50.918552 30546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:28:50.930421 30546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.65.keytab
--principal=oryx/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:39547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=42661
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:50.932018 30546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:50.933512 30546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:50.949419 30582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:50.949364 30584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:50.950523 30586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:50.950592 30546 server_base.cc:1034] running on GCE node
I20260806 19:28:50.951346 30546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:50.952486 30546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:50.953722 30546 hybrid_clock.cc:648] HybridClock initialized: now 1786044530953646 us; error 52 us; skew 500 ppm
I20260806 19:28:50.954057 30546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:50 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044530, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:50.957667 30546 init.cc:377] Logged in from keytab as oryx/127.17.18.65@KRBTEST.COM (short username oryx)
I20260806 19:28:50.959508 30546 webserver.cc:460] Webserver started at http://127.17.18.65:42661/ using document root <none> and password file <none>
I20260806 19:28:50.960319 30546 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:50.960474 30546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:50.967144 30546 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:50.970459 30597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:50.972234 30546 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:50.972431 30546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "b71f73fcc70c4f66a78424f42ed0db10"
format_stamp: "Formatted at 2026-08-06 19:28:47 on dist-test-slave-f0tn"
server_key: "9c67ac33113e45d78256a7180c7ab899"
server_key_iv: "bc520b1b24bf536a050c07b82a1a9217"
server_key_version: "encryptionkey@0"
I20260806 19:28:50.973610 30546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:51.001538 30546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:51.006477 30546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:51.006793 30546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:51.007973 30546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:51.009662 30546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:51.009792 30546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:51.009913 30546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:51.010001 30546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:51.045213 30546 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:39547
I20260806 19:28:51.045269 30765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:39547 every 8 connection(s)
I20260806 19:28:51.046774 30546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:28:51.047323 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30546
I20260806 19:28:51.048134 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:38613
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:40155
--webserver_port=43387
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:28:51 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:51 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 19:28:51.473166 30770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:51.473546 30770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:51.473706 30770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:51.481457 30770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:51.481611 30770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:51.481797 30770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:28:51.492189 30770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.66.keytab
--principal=oryx/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:38613
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=43387
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:51.493778 30770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:51.495196 30770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:51.513424 30777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:51.515272 30779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:51.516386 30782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:51.516837 30770 server_base.cc:1034] running on GCE node
I20260806 19:28:51.517628 30770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:51.518798 30770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:51.520183 30770 hybrid_clock.cc:648] HybridClock initialized: now 1786044531520098 us; error 81 us; skew 500 ppm
I20260806 19:28:51.520599 30770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:51 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044531, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:51.524816 30770 init.cc:377] Logged in from keytab as oryx/127.17.18.66@KRBTEST.COM (short username oryx)
I20260806 19:28:51.526829 30770 webserver.cc:460] Webserver started at http://127.17.18.66:43387/ using document root <none> and password file <none>
I20260806 19:28:51.527710 30770 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:51.527884 30770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:51.534873 30770 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 19:28:51.538731 30791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:51.540668 30770 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:28:51.540869 30770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "1da52717c06645a3b94159dd63672d64"
format_stamp: "Formatted at 2026-08-06 19:28:48 on dist-test-slave-f0tn"
server_key: "4a1d67cd174af6725166528cac46601c"
server_key_iv: "cccaa12b449f05004e732c605e42fc6b"
server_key_version: "encryptionkey@0"
I20260806 19:28:51.542086 30770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:51.558815 30770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:51.563483 30770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:51.563774 30770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:51.564908 30770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:51.566689 30770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:51.566794 30770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:51.566905 30770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:51.566979 30770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:51.621435 30770 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:38613
I20260806 19:28:51.621490 30943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:38613 every 8 connection(s)
I20260806 19:28:51.623971 30770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:28:51.633630 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30770
I20260806 19:28:51.634452 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:44537
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:40155
--webserver_port=45977
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:41571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:28:51 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:51 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 19:28:52.148583 30769 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.085s user 0.000s sys 0.017s
W20260806 19:28:52.150735 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:51.050521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:50741 (local address 127.17.18.126:40155)
0806 19:28:51.051344 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:51.051361 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:51.052097 (+ 736us) server_negotiation.cc:407] Connection header received
0806 19:28:51.054663 (+ 2566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:51.054684 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:51.055228 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:51.055677 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:51.057276 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.059085 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.060825 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.061865 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.062064 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.149930 (+1087866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:50741: BlockingRecv error: recv got EOF from 127.17.18.65:50741 (error 108)
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":296,"threads_started":1}
I20260806 19:28:52.150710 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:51.050548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:50741)
0806 19:28:51.051866 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:51.051918 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:51.053892 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:51.055830 (+ 1938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:51.055840 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:51.056446 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:51.057017 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:51.057038 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.059306 (+ 2268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.059311 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:51.060633 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:51.060649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.062100 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.062106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:51.062321 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:51.063077 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:51.063104 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.149463 (+1086359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1010,"thread_start_us":759,"threads_started":1}
W20260806 19:28:52.152019 30766 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:40155 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.18.126:40155: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:52.163148 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.152841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:50811)
0806 19:28:52.153665 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:52.153689 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:52.153852 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:52.154377 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:52.154382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:52.154787 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:52.154969 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.154979 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.156171 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.156176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.157166 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.157183 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.158030 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.158037 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.158197 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.158831 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:52.158850 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.162816 (+ 3966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":1421,"threads_started":1}
W20260806 19:28:52.163347 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:52.153348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:50811 (local address 127.17.18.126:40155)
0806 19:28:52.153562 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.153567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.153764 (+ 197us) server_negotiation.cc:407] Connection header received
0806 19:28:52.153978 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.153983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.154073 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.154173 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.155165 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.155937 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.157347 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.157817 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.157946 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.163119 (+ 5173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:50811: BlockingRecv error: recv got EOF from 127.17.18.65:50811 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:52.173760 30769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.164244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:48959)
0806 19:28:52.164602 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:52.164618 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:52.164744 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:52.165097 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:52.165102 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:52.165547 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:52.165735 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.165747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.166919 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.166925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.167966 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.167982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.168751 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.168757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.168939 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.169587 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:52.169605 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.173458 (+ 3853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254}
W20260806 19:28:52.173975 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:52.164320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48959 (local address 127.17.18.126:40155)
0806 19:28:52.164480 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.164485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.164756 (+ 271us) server_negotiation.cc:407] Connection header received
0806 19:28:52.164877 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.164882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.164955 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.165049 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.165920 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.166755 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.168149 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.168575 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.168697 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.173749 (+ 5052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:48959: BlockingRecv error: recv got EOF from 127.17.18.65:48959 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 19:28:52.174419 30766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:28:52.243516 30949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:28:52.244066 30949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:28:52.244242 30949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:28:52.257725 30949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:28:52.257956 30949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:28:52.258174 30949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:28:52.277338 30949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:41571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/krb5kdc/oryx_127.17.18.67.keytab
--principal=oryx/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:44537
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=45977
--tserver_master_addrs=127.17.18.126:40155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:28:52.279686 30949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:28:52.281898 30949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:28:52.300360 30963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:52.300277 30961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:28:52.300303 30959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:28:52.301425 30949 server_base.cc:1034] running on GCE node
I20260806 19:28:52.302125 30949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:28:52.303227 30949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:28:52.304540 30949 hybrid_clock.cc:648] HybridClock initialized: now 1786044532304458 us; error 85 us; skew 500 ppm
I20260806 19:28:52.304935 30949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044532, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:28:52.311929 30949 init.cc:377] Logged in from keytab as oryx/127.17.18.67@KRBTEST.COM (short username oryx)
I20260806 19:28:52.313771 30949 webserver.cc:460] Webserver started at http://127.17.18.67:45977/ using document root <none> and password file <none>
I20260806 19:28:52.314543 30949 fs_manager.cc:359] Metadata directory not provided
I20260806 19:28:52.314687 30949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:28:52.321499 30949 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 19:28:52.324992 30974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:52.326861 30949 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:28:52.327068 30949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "e96b9bffdf874e0099b84112a2bbb043"
format_stamp: "Formatted at 2026-08-06 19:28:49 on dist-test-slave-f0tn"
server_key: "71c1e960a1617ab5a58a0ee4cab19585"
server_key_iv: "268a7baeee849945f4c5a0b2bfafe43a"
server_key_version: "encryptionkey@0"
I20260806 19:28:52.328368 30949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:28:52.351468 30949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:28:52.356057 30949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:28:52.356356 30949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:28:52.357499 30949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:28:52.359076 30949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:28:52.359189 30949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:52.359304 30949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:28:52.359375 30949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:28:52.398547 30949 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44537
I20260806 19:28:52.398594 31126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44537 every 8 connection(s)
I20260806 19:28:52.400272 30949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:28:52.407442 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 30949
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:52.440938 31132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.408690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57140 (local address 127.17.18.126:40155)
0806 19:28:52.419432 (+ 10742us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.419436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.419452 (+ 16us) server_negotiation.cc:407] Connection header received
0806 19:28:52.419497 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.419500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.419558 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.419665 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.421737 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.423154 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.425137 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.425912 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.426062 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.429749 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:28:52.429765 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:28:52.429801 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:28:52.429877 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:28:52.436891 (+ 7014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:52.437884 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:52.437893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:52.437902 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:52.438128 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:28:52.438593 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:28:52.438599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:28:52.438602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:28:52.439218 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:28:52.439586 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0806 19:28:52.440116 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 19:28:52.440572 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10612,"thread_start_us":9694,"threads_started":1}
W20260806 19:28:52.794255 30948 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.149s user 0.007s sys 0.021s
W20260806 19:28:52.795918 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:51.628074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:42747 (local address 127.17.18.126:40155)
0806 19:28:51.628778 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:51.628788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:51.629970 (+ 1182us) server_negotiation.cc:407] Connection header received
0806 19:28:51.632317 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:51.632326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:51.632473 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:51.632662 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:51.635730 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.638461 (+ 2731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.641844 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.642871 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.643124 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.795655 (+1152531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:42747: BlockingRecv error: recv got EOF from 127.17.18.66:42747 (error 108)
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":316,"threads_started":1}
I20260806 19:28:52.796947 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:51.628754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:42747)
0806 19:28:51.629760 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:51.629816 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:51.631827 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:51.633046 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:51.633061 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:51.634064 (+ 1003us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:51.635257 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:51.635298 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.638884 (+ 3586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.638892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:51.641498 (+ 2606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:51.641529 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:51.643289 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:51.643298 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:51.643659 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:51.644894 (+ 1235us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:51.644930 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.795471 (+1150541us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":377,"threads_started":1}
W20260806 19:28:52.798125 30944 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:40155 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.18.126:40155: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:52.811437 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.798873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:55763)
0806 19:28:52.799137 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:52.799164 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:52.799329 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:52.799703 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:52.799710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:52.800297 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:52.800585 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.800600 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.802063 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.802070 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.803868 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.803893 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.805153 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.805161 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.805413 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.806312 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:52.806342 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.811195 (+ 4853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":81}
W20260806 19:28:52.811849 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:52.799147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:55763 (local address 127.17.18.126:40155)
0806 19:28:52.799312 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.799317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.799337 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:28:52.799464 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.799468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.799535 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.799630 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.800840 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.801879 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.804183 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.804905 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.805079 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.811555 (+ 6476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:55763: BlockingRecv error: recv got EOF from 127.17.18.66:55763 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:52 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:52.823577 30948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.812441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:47013)
0806 19:28:52.812717 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:52.812745 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:52.812896 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:52.813274 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:52.813279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:52.813861 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:52.814142 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.814159 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.815358 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.815363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.817154 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.817180 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.818203 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.818210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.818411 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.819124 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:52.819149 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:52.823271 (+ 4122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260806 19:28:52.824018 30944 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:28:52.823820 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:52.812719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:47013 (local address 127.17.18.126:40155)
0806 19:28:52.812874 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.812879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.812897 (+ 18us) server_negotiation.cc:407] Connection header received
0806 19:28:52.813023 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.813027 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.813106 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.813201 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.814369 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.815152 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.817442 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.817975 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.818112 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.823556 (+ 5444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:47013: BlockingRecv error: recv got EOF from 127.17.18.66:47013 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:53.186632 31134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:53.175693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:34823)
0806 19:28:53.176520 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:53.176542 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:53.176716 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:53.177121 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:53.177127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:53.177717 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:53.177891 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.177902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.179004 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.179008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.180020 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.180036 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.180871 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.180878 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.181050 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.181812 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:53.181832 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:53.186262 (+ 4430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":398,"threads_started":1}
W20260806 19:28:53.187009 30947 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:53.175374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:34823 (local address 127.17.18.126:40155)
0806 19:28:53.175549 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:53.175555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:53.176683 (+ 1128us) server_negotiation.cc:407] Connection header received
0806 19:28:53.176873 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:53.176879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:53.176982 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:53.177093 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:53.178084 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.178828 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.180215 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.180645 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.180771 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.186690 (+ 5919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:34823: BlockingRecv error: recv got EOF from 127.17.18.65:34823 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 19:28:53.458695 31130 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.040s user 0.003s sys 0.013s
W20260806 19:28:53.459846 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:52.404224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:49479 (local address 127.17.18.126:40155)
0806 19:28:52.404475 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:52.404482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:52.405842 (+ 1360us) server_negotiation.cc:407] Connection header received
0806 19:28:52.408089 (+ 2247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:52.408096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:52.408201 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:52.408316 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:52.411238 (+ 2922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.412504 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.415582 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.416452 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.416574 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.459645 (+1043071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:49479: BlockingRecv error: recv got EOF from 127.17.18.67:49479 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 19:28:53.460456 31130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:52.404659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:49479)
0806 19:28:52.405641 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:52.405693 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:52.407746 (+ 2053us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:52.408773 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:52.408789 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:52.409854 (+ 1065us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:52.410914 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.410949 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.412835 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.412843 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.415304 (+ 2461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:52.415329 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:52.417096 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:52.417104 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:52.417530 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:52.418537 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:52.418584 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:53.459479 (+1040895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":404,"threads_started":1}
W20260806 19:28:53.461447 31128 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:40155 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.18.126:40155: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:53.471724 31130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:53.462241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:33073)
0806 19:28:53.462433 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:53.462452 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:53.462576 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:53.462937 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:53.462940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:53.463312 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:53.463488 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.463519 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.464636 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.464641 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.465704 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.465718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.466501 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.466509 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.466668 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.467258 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:53.467295 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:53.471415 (+ 4120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 19:28:53.471940 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:53.462379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:33073 (local address 127.17.18.126:40155)
0806 19:28:53.462615 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:53.462620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:53.462640 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:28:53.462694 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:53.462697 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:53.462761 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:53.462849 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:53.463685 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.464462 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.465829 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.466291 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.466398 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.471696 (+ 5298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:33073: BlockingRecv error: recv got EOF from 127.17.18.67:33073 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:53.481438 31130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:53.472692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:39751)
0806 19:28:53.472864 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:53.472886 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:53.473012 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:53.473412 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:53.473417 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:53.473786 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:53.473962 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.473971 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.475022 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.475026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.476002 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.476016 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.476760 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.476766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.476934 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.477586 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:53.477605 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:53.481118 (+ 3513us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 19:28:53.481648 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:53.472806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:39751 (local address 127.17.18.126:40155)
0806 19:28:53.472976 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:53.472981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:53.473000 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:28:53.473136 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:53.473142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:53.473231 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:53.473317 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:53.474120 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.474870 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.476158 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.476589 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.476703 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.481423 (+ 4720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:39751: BlockingRecv error: recv got EOF from 127.17.18.67:39751 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 19:28:53.481912 31128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:53 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:53.834466 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:53.824755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:42381)
0806 19:28:53.825323 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:53.825341 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:53.825528 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:53.825899 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:53.825904 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:53.826373 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:53.826568 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.826578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.827641 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.827645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.828674 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:53.828688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.829477 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.829484 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:53.829646 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.830228 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:53.830248 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:53.834203 (+ 3955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":315,"threads_started":1}
W20260806 19:28:53.834793 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:53.824811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:42381 (local address 127.17.18.126:40155)
0806 19:28:53.825033 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:53.825048 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:53.825450 (+ 402us) server_negotiation.cc:407] Connection header received
0806 19:28:53.825658 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:53.825663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:53.825745 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:53.825833 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:53.826729 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.827476 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.828839 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:53.829241 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:53.829358 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:53.834521 (+ 5163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:42381: BlockingRecv error: recv got EOF from 127.17.18.66:42381 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:54.197727 31136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:54.188435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:59129)
0806 19:28:54.188986 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:54.189003 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:54.189197 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:54.189572 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:54.189577 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:54.190048 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:54.190238 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.190247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.191314 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.191317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.192251 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.192266 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.193083 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.193089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.193246 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.193899 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:54.193918 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:54.197366 (+ 3448us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":309,"threads_started":1}
W20260806 19:28:54.197882 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:54.188611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:59129 (local address 127.17.18.126:40155)
0806 19:28:54.188847 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:54.188853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:54.189134 (+ 281us) server_negotiation.cc:407] Connection header received
0806 19:28:54.189334 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:54.189339 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:54.189426 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:54.189540 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:54.190412 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.191158 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.192417 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.192872 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.192992 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.197641 (+ 4649us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:59129: BlockingRecv error: recv got EOF from 127.17.18.65:59129 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:54.493027 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:54.482803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:45077)
0806 19:28:54.483480 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:54.483497 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:54.483651 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:54.483974 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:54.483977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:54.484451 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:54.484635 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.484647 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.485890 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.485896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.487039 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.487056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.487856 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.487862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.487997 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.488669 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:54.488690 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:54.492674 (+ 3984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":420,"threads_started":1}
W20260806 19:28:54.493266 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:54.482906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:45077 (local address 127.17.18.126:40155)
0806 19:28:54.483143 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:54.483151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:54.483595 (+ 444us) server_negotiation.cc:407] Connection header received
0806 19:28:54.483754 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:54.483759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:54.483845 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:54.483937 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:54.484825 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.485740 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.487209 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.487633 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.487752 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.493002 (+ 5250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:45077: BlockingRecv error: recv got EOF from 127.17.18.67:45077 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:54 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:54.845139 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:54.835496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:37413)
0806 19:28:54.836042 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:54.836058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:54.836211 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:54.836548 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:54.836553 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:54.836986 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:54.837189 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.837199 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.838281 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.838287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.839273 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:54.839286 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.840038 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.840044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:54.840219 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.840826 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:54.840842 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:54.844815 (+ 3973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":317,"threads_started":1}
W20260806 19:28:54.845330 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:54.835635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:37413 (local address 127.17.18.126:40155)
0806 19:28:54.835897 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:54.835904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:54.836148 (+ 244us) server_negotiation.cc:407] Connection header received
0806 19:28:54.836340 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:54.836344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:54.836410 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:54.836496 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:54.837346 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.838138 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.839418 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:54.839877 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:54.839988 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:54.845133 (+ 5145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:37413: BlockingRecv error: recv got EOF from 127.17.18.66:37413 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:55.209295 31139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:55.199056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:59733)
0806 19:28:55.199926 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:55.199947 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:55.200092 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:55.200473 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:55.200479 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:55.200971 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:55.201210 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.201225 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.202514 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.202519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.203454 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.203469 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.204269 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.204274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.204423 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.205082 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:55.205146 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:55.209014 (+ 3868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":340,"threads_started":1}
W20260806 19:28:55.209551 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:55.199388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:59733 (local address 127.17.18.126:40155)
0806 19:28:55.199624 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:55.199630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:55.200071 (+ 441us) server_negotiation.cc:407] Connection header received
0806 19:28:55.200203 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:55.200209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:55.200290 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:55.200391 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:55.201414 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.202345 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.203625 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.204072 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.204202 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.209290 (+ 5088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:59733: BlockingRecv error: recv got EOF from 127.17.18.65:59733 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:55.504141 31142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:55.494273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:40059)
0806 19:28:55.494812 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:55.494828 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:55.494978 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:55.495367 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:55.495372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:55.495861 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:55.496067 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.496079 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.497188 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.497193 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.498212 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.498227 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.499056 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.499063 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.499249 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.499977 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:55.499997 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:55.503823 (+ 3826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":313,"threads_started":1}
W20260806 19:28:55.504426 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:55.494355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:40059 (local address 127.17.18.126:40155)
0806 19:28:55.494559 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:55.494566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:55.494928 (+ 362us) server_negotiation.cc:407] Connection header received
0806 19:28:55.495108 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:55.495113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:55.495215 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:55.495304 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:55.496254 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.497012 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.498388 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.498878 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.499005 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.504149 (+ 5144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:40059: BlockingRecv error: recv got EOF from 127.17.18.67:40059 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:55 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:55.856227 31143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:55.846425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:46145)
0806 19:28:55.847034 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:55.847052 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:55.847235 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:55.847610 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:55.847614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:55.848024 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:55.848268 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.848280 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.849485 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.849490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.850666 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:55.850684 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.851438 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.851443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:55.851595 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.852273 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:55.852292 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:55.855958 (+ 3666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":308,"threads_started":1}
W20260806 19:28:55.856484 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:55.846585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46145 (local address 127.17.18.126:40155)
0806 19:28:55.846859 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:55.846866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:55.847161 (+ 295us) server_negotiation.cc:407] Connection header received
0806 19:28:55.847373 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:55.847377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:55.847447 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:55.847558 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:55.848465 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.849286 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.850837 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:55.851266 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:55.851374 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:55.856244 (+ 4870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:46145: BlockingRecv error: recv got EOF from 127.17.18.66:46145 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:56.222393 31145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:56.210725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:33471)
0806 19:28:56.211311 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:56.211330 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:56.211479 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:56.212121 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:56.212127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:56.212699 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:56.212903 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.212915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.214325 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.214330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.215391 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.215408 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.216178 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.216184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.216365 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.217106 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:56.217131 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:56.221986 (+ 4855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":295,"threads_started":1}
W20260806 19:28:56.222591 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:56.210926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:33471 (local address 127.17.18.126:40155)
0806 19:28:56.211217 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:56.211223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:56.211433 (+ 210us) server_negotiation.cc:407] Connection header received
0806 19:28:56.211613 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:56.211619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:56.211723 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:56.211828 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:56.213154 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.214172 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.215582 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.216003 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.216126 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.222289 (+ 6163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:33471: BlockingRecv error: recv got EOF from 127.17.18.65:33471 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:56.515997 31147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:56.505498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:50455)
0806 19:28:56.506340 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:56.506357 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:56.506519 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:56.506894 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:56.506899 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:56.507329 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:56.507513 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.507522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.508573 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.508579 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.509615 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.509633 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.510423 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.510429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.510610 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.511292 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:56.511312 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:56.515678 (+ 4366us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":714,"thread_start_us":513,"threads_started":1}
W20260806 19:28:56.517128 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:56.505684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:50455 (local address 127.17.18.126:40155)
0806 19:28:56.505935 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:56.505943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:56.506460 (+ 517us) server_negotiation.cc:407] Connection header received
0806 19:28:56.506649 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:56.506655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:56.506736 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:56.506825 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:56.507675 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.508415 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.509792 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.510248 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.510374 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.516726 (+ 6352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:50455: BlockingRecv error: recv got EOF from 127.17.18.67:50455 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:56 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:56.866796 31148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:56.857534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:41941)
0806 19:28:56.858123 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:56.858140 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:56.858296 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:56.858656 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:56.858661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:56.859097 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:56.859309 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.859320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.860405 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.860409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.861456 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:56.861471 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.862190 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.862196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:56.862368 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.862940 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:56.862958 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:56.866523 (+ 3565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":329,"threads_started":1}
W20260806 19:28:56.867024 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:56.857640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:41941 (local address 127.17.18.126:40155)
0806 19:28:56.857875 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:56.857883 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:56.858245 (+ 362us) server_negotiation.cc:407] Connection header received
0806 19:28:56.858428 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:56.858432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:56.858501 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:56.858588 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:56.859472 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.860249 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.861609 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:56.862031 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:56.862148 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:56.866765 (+ 4617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:41941: BlockingRecv error: recv got EOF from 127.17.18.66:41941 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:57.233839 31149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:57.223828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:45671)
0806 19:28:57.224414 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:57.224439 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:57.224628 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:57.225050 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:57.225055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:57.225695 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:57.225890 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.225901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.227141 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.227146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.228128 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.228143 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.228967 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.228972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.229120 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.229788 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:57.229806 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:57.233575 (+ 3769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":294,"threads_started":1}
W20260806 19:28:57.234151 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:57.224096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:45671 (local address 127.17.18.126:40155)
0806 19:28:57.224323 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:57.224329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:57.224556 (+ 227us) server_negotiation.cc:407] Connection header received
0806 19:28:57.224786 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:57.224790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:57.224861 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:57.224979 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:57.226044 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.226957 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.228299 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.228792 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.228896 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.233875 (+ 4979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:45671: BlockingRecv error: recv got EOF from 127.17.18.65:45671 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:57.531605 31150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:57.518476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:60235)
0806 19:28:57.519069 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:57.519087 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:57.519218 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:57.519557 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:57.519560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:57.519996 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:57.520226 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.520239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.521552 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.521558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.522695 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.522722 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.523501 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.523506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.523656 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.527233 (+ 3577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:57.527259 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:57.531314 (+ 4055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":330,"threads_started":1}
W20260806 19:28:57.531857 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:57.518585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:60235 (local address 127.17.18.126:40155)
0806 19:28:57.518764 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:57.518769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:57.519162 (+ 393us) server_negotiation.cc:407] Connection header received
0806 19:28:57.519343 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:57.519347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:57.519435 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:57.519528 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:57.520398 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.521357 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.522866 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.523308 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.523413 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.531615 (+ 8202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:60235: BlockingRecv error: recv got EOF from 127.17.18.67:60235 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:57 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:57.877909 31151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:57.868061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:43127)
0806 19:28:57.868604 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:57.868625 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:57.868789 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:57.869149 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:57.869153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:57.869675 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:57.869841 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.869851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.870942 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.870946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.871929 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:57.871944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.872796 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.872802 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:57.872978 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.873799 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:57.873825 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:57.877661 (+ 3836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":265,"threads_started":1}
W20260806 19:28:57.878396 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:57.868372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:43127 (local address 127.17.18.126:40155)
0806 19:28:57.868600 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:57.868607 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:57.868728 (+ 121us) server_negotiation.cc:407] Connection header received
0806 19:28:57.868919 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:57.868925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:57.869001 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:57.869090 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:57.870019 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.870774 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.872104 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:57.872624 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:57.872762 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:57.878110 (+ 5348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:43127: BlockingRecv error: recv got EOF from 127.17.18.66:43127 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:58.245009 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:58.234935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:49949)
0806 19:28:58.235498 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:58.235515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:58.235644 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:58.236023 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:58.236027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:58.236490 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:58.236676 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.236699 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.237893 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.237898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.238944 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.238960 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.239850 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.239856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.240006 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.240660 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:58.240679 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:58.244651 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":317,"threads_started":1}
W20260806 19:28:58.245227 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:58.235063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:49949 (local address 127.17.18.126:40155)
0806 19:28:58.235268 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:58.235273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:58.235620 (+ 347us) server_negotiation.cc:407] Connection header received
0806 19:28:58.235805 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:58.235809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:58.235885 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:58.235983 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:58.236849 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.237705 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.239111 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.239672 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.239782 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.244880 (+ 5098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:49949: BlockingRecv error: recv got EOF from 127.17.18.65:49949 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:58.544749 31154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:58.532621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:33237)
0806 19:28:58.533147 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:58.533164 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:58.533321 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:58.533777 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:58.533781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:58.534300 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:58.534527 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.534541 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.536091 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.536097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.537621 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.537641 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.538885 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.538892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.539149 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.540053 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:58.540080 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:58.544491 (+ 4411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":277,"threads_started":1}
W20260806 19:28:58.545006 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:58.532780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:33237 (local address 127.17.18.126:40155)
0806 19:28:58.533010 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:58.533017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:58.533273 (+ 256us) server_negotiation.cc:407] Connection header received
0806 19:28:58.533455 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:58.533459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:58.533546 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:58.533650 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:58.534735 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.535849 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.537813 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.538463 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.538603 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.544744 (+ 6141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:33237: BlockingRecv error: recv got EOF from 127.17.18.67:33237 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:58 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:58.889494 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:58.879103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:60561)
0806 19:28:58.879640 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:58.879660 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:58.879819 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:58.880397 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:58.880401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:58.881193 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:58.881434 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.881449 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.882754 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.882760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.883695 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:58.883708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.884462 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.884469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:58.884655 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.885327 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:58.885345 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:58.889113 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":287,"threads_started":1}
W20260806 19:28:58.889737 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:58.879258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:60561 (local address 127.17.18.126:40155)
0806 19:28:58.879464 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:58.879470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:58.879772 (+ 302us) server_negotiation.cc:407] Connection header received
0806 19:28:58.879985 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:58.879992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:58.880076 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:58.880150 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:58.881618 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.882603 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.883854 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:58.884290 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:58.884403 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:58.889451 (+ 5048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:60561: BlockingRecv error: recv got EOF from 127.17.18.66:60561 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:59.256400 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:59.246283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:56267)
0806 19:28:59.246877 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:59.246895 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:59.247104 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:59.247529 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:59.247533 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:59.247995 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:59.248229 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.248246 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.249416 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.249421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.250383 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.250400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.251408 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.251414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.251559 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.252346 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:59.252366 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:59.256041 (+ 3675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":266,"threads_started":1}
W20260806 19:28:59.256577 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:59.246456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56267 (local address 127.17.18.126:40155)
0806 19:28:59.246718 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:59.246725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:59.247027 (+ 302us) server_negotiation.cc:407] Connection header received
0806 19:28:59.247266 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:59.247271 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:59.247343 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:59.247434 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:59.248400 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.249245 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.250561 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.251224 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.251334 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.256332 (+ 4998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:56267: BlockingRecv error: recv got EOF from 127.17.18.65:56267 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:59.556375 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:59.546035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:43273)
0806 19:28:59.546532 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:59.546549 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:59.546685 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:59.547203 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:59.547207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:59.547663 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:59.547845 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.547855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.549226 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.549233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.550421 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.550438 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.551326 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.551332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.551474 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.552203 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:59.552225 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:59.556093 (+ 3868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":260,"threads_started":1}
W20260806 19:28:59.556668 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:59.546259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:43273 (local address 127.17.18.126:40155)
0806 19:28:59.546525 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:59.546532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:59.546633 (+ 101us) server_negotiation.cc:407] Connection header received
0806 19:28:59.546819 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:59.546824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:59.546896 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:59.547033 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:59.548024 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.548964 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.550644 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.551110 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.551223 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.556388 (+ 5165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:43273: BlockingRecv error: recv got EOF from 127.17.18.67:43273 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:28:59 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:28:59.902347 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:28:59.890900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:42961)
0806 19:28:59.891573 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 19:28:59.891591 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:28:59.891722 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:28:59.892099 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:28:59.892103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:28:59.892601 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:28:59.892855 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.892867 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.894233 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.894239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.895417 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:28:59.895433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.896214 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.896219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:28:59.896344 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.897045 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:28:59.897069 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:28:59.902052 (+ 4983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":318,"threads_started":1}
W20260806 19:28:59.902716 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:28:59.891046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:42961 (local address 127.17.18.126:40155)
0806 19:28:59.891298 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 19:28:59.891303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:28:59.891712 (+ 409us) server_negotiation.cc:407] Connection header received
0806 19:28:59.891820 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:28:59.891824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:28:59.891894 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:28:59.891985 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:28:59.893058 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.894059 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.895576 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:28:59.896031 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:28:59.896131 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:28:59.902421 (+ 6290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:42961: BlockingRecv error: recv got EOF from 127.17.18.66:42961 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:00.270259 31162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:00.257783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:49269)
0806 19:29:00.258387 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:00.258405 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:00.258554 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:00.258988 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:00.258992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:00.259467 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:00.259727 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.259744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.261286 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.261291 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.262589 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.262610 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.263693 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.263704 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.263926 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.264898 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:00.264926 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:00.269963 (+ 5037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":360,"threads_started":1}
W20260806 19:29:00.270660 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:00.258003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:49269 (local address 127.17.18.126:40155)
0806 19:29:00.258359 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:00.258366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:00.258577 (+ 211us) server_negotiation.cc:407] Connection header received
0806 19:29:00.258666 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:00.258671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:00.258756 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:00.258864 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:00.259929 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.261044 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.262789 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.263280 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.263410 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.270385 (+ 6975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:49269: BlockingRecv error: recv got EOF from 127.17.18.65:49269 (error 108)
Metrics: {"server-negotiator.queue_time_us":187}
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:00.566763 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:00.557312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:34237)
0806 19:29:00.558009 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:00.558028 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:00.558196 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:00.558578 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:00.558582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:00.559011 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:00.559195 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.559204 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.560284 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.560289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.561253 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.561267 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.562086 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.562093 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.562256 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.562883 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:00.562902 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:00.566408 (+ 3506us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":310,"threads_started":1}
W20260806 19:29:00.566942 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:00.557511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:34237 (local address 127.17.18.126:40155)
0806 19:29:00.557767 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:00.557774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:00.558130 (+ 356us) server_negotiation.cc:407] Connection header received
0806 19:29:00.558330 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:00.558335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:00.558402 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:00.558486 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:00.559365 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.560114 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.561434 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.561920 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.562050 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.566705 (+ 4655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:34237: BlockingRecv error: recv got EOF from 127.17.18.67:34237 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:00 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 19:29:00.913900 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:00.903623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:50905 (local address 127.17.18.126:40155)
0806 19:29:00.903841 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:00.903847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:00.904160 (+ 313us) server_negotiation.cc:407] Connection header received
0806 19:29:00.904338 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:00.904342 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:00.904411 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:00.904484 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:00.905346 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.906331 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.907733 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.908186 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.908299 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.913677 (+ 5378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:50905: BlockingRecv error: recv got EOF from 127.17.18.66:50905 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:29:00.913913 31164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:00.903521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:50905)
0806 19:29:00.904060 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:00.904077 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:00.904202 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:00.904521 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:00.904524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:00.904964 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:00.905146 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.905155 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.906523 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.906528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.907544 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:00.907560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:00.908390 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:00.908395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:00.908549 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:00.909331 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:00.909352 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:00.913615 (+ 4263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":272,"threads_started":1}
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:01.281112 31165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:01.271422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:56615)
0806 19:29:01.271949 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:01.271971 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:01.272097 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:01.272432 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:01.272436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:01.272868 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:01.273022 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.273031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.274137 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.274142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.275119 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.275133 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.275916 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.275921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.276066 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.276653 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:01.276677 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:01.280779 (+ 4102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":286,"threads_started":1}
W20260806 19:29:01.281370 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:01.271503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56615 (local address 127.17.18.126:40155)
0806 19:29:01.271686 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:01.271691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:01.272052 (+ 361us) server_negotiation.cc:407] Connection header received
0806 19:29:01.272200 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:01.272204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:01.272293 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:01.272379 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:01.273164 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.273976 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.275292 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.275739 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.275849 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.281061 (+ 5212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:56615: BlockingRecv error: recv got EOF from 127.17.18.65:56615 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:01.578394 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:01.568098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:55529)
0806 19:29:01.568662 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:01.568679 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:01.568812 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:01.569134 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:01.569138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:01.569634 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:01.569816 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.569826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.571028 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.571033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.572096 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.572113 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.573200 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.573205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.573345 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.574089 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:01.574110 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:01.578101 (+ 3991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":283,"threads_started":1}
W20260806 19:29:01.578693 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:01.568232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:55529 (local address 127.17.18.126:40155)
0806 19:29:01.568415 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:01.568421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:01.568799 (+ 378us) server_negotiation.cc:407] Connection header received
0806 19:29:01.568918 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:01.568922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:01.569004 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:01.569102 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:01.569984 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.570846 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.572283 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.572978 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.573107 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.578428 (+ 5321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:55529: BlockingRecv error: recv got EOF from 127.17.18.67:55529 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:01 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:01.926282 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:01.915335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:40693)
0806 19:29:01.916021 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:01.916041 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:01.916199 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:01.916693 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:01.916698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:01.917218 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:01.917451 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.917466 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.918527 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.918531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.919517 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:01.919530 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.920506 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.920512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:01.920660 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.921513 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:01.921543 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:01.926018 (+ 4475us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":417,"threads_started":1}
W20260806 19:29:01.926586 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:01.915524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:40693 (local address 127.17.18.126:40155)
0806 19:29:01.915782 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:01.915788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:01.916183 (+ 395us) server_negotiation.cc:407] Connection header received
0806 19:29:01.916321 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:01.916327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:01.916423 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:01.916570 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:01.917597 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.918378 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.919701 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:01.920318 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:01.920436 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:01.926332 (+ 5896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:40693: BlockingRecv error: recv got EOF from 127.17.18.66:40693 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:02.291991 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:02.282284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:57695)
0806 19:29:02.282833 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:02.282852 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:02.283033 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:02.283358 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:02.283362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:02.283805 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:02.284022 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.284032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.285095 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.285100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.286185 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.286200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.287104 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.287110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.287294 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.288057 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:02.288083 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:02.291729 (+ 3646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":278,"threads_started":1}
W20260806 19:29:02.292251 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:02.282540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:57695 (local address 127.17.18.126:40155)
0806 19:29:02.282780 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:02.282784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:02.282931 (+ 147us) server_negotiation.cc:407] Connection header received
0806 19:29:02.283154 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:02.283159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:02.283233 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:02.283320 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:02.284171 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.284914 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.286328 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.286885 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.287023 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.291966 (+ 4943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:57695: BlockingRecv error: recv got EOF from 127.17.18.65:57695 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:02.592959 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:02.579647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:59527)
0806 19:29:02.580262 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:02.580283 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:02.580421 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:02.580795 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:02.580799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:02.581362 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:02.581584 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.581596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.582729 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.582734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.584037 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.584053 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.584765 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.584771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.584945 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.588656 (+ 3711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:02.588681 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:02.592652 (+ 3971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":310,"threads_started":1}
W20260806 19:29:02.593195 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:02.579753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:59527 (local address 127.17.18.126:40155)
0806 19:29:02.579983 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:02.579990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:02.580366 (+ 376us) server_negotiation.cc:407] Connection header received
0806 19:29:02.580542 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:02.580547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:02.580628 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:02.580731 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:02.581754 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.582547 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.584195 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.584607 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.584730 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.592900 (+ 8170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:59527: BlockingRecv error: recv got EOF from 127.17.18.67:59527 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:02 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:02.937170 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:02.927502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:58841)
0806 19:29:02.928089 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:02.928108 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:02.928250 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:02.928568 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:02.928572 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:02.928991 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:02.929176 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.929188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.930301 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.930306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.931338 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:02.931354 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.932350 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.932357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:02.932519 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.933251 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:02.933278 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:02.936825 (+ 3547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":295,"threads_started":1}
W20260806 19:29:02.937322 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:02.927644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:58841 (local address 127.17.18.126:40155)
0806 19:29:02.927886 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:02.927892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:02.928198 (+ 306us) server_negotiation.cc:407] Connection header received
0806 19:29:02.928358 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:02.928363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:02.928432 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:02.928533 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:02.929349 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.930133 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.931540 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:02.932195 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:02.932316 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:02.937092 (+ 4776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:58841: BlockingRecv error: recv got EOF from 127.17.18.66:58841 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:03.302713 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:03.293124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:54933)
0806 19:29:03.293711 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:03.293729 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:03.293856 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:03.294171 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:03.294174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:03.294626 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:03.294817 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.294827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.295906 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.295911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.296865 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.296880 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.297692 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.297697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.297836 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.298462 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:03.298480 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:03.302449 (+ 3969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":333,"threads_started":1}
W20260806 19:29:03.302901 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:03.293368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:54933 (local address 127.17.18.126:40155)
0806 19:29:03.293571 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:03.293576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:03.293811 (+ 235us) server_negotiation.cc:407] Connection header received
0806 19:29:03.293959 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:03.293963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:03.294029 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:03.294117 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:03.294973 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.295763 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.297024 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.297513 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.297616 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.302650 (+ 5034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:54933: BlockingRecv error: recv got EOF from 127.17.18.65:54933 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:03.604295 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:03.594223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:34739)
0806 19:29:03.594968 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:03.594984 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:03.595113 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:03.595454 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:03.595458 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:03.595891 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:03.596058 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.596068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.597197 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.597202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.598301 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.598316 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.599101 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.599107 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.599233 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.599880 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:03.599900 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:03.604025 (+ 4125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":513,"threads_started":1}
W20260806 19:29:03.604676 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:03.594447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:34739 (local address 127.17.18.126:40155)
0806 19:29:03.594630 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:03.594637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:03.595098 (+ 461us) server_negotiation.cc:407] Connection header received
0806 19:29:03.595204 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:03.595208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:03.595278 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:03.595359 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:03.596270 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.597013 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.598471 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.598940 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.599054 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.604330 (+ 5276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:34739: BlockingRecv error: recv got EOF from 127.17.18.67:34739 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:03 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:03.948175 31174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:03.938310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:37629)
0806 19:29:03.938770 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:03.938787 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:03.938919 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:03.939322 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:03.939326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:03.939815 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:03.940031 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.940042 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.941187 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.941191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.942144 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:03.942158 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.942904 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.942909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:03.943100 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.943796 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:03.943817 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:03.947926 (+ 4109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":252,"threads_started":1}
W20260806 19:29:03.948401 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:03.938411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:37629 (local address 127.17.18.126:40155)
0806 19:29:03.938650 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:03.938656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:03.938919 (+ 263us) server_negotiation.cc:407] Connection header received
0806 19:29:03.939008 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:03.939012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:03.939125 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:03.939218 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:03.940251 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.941064 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.942277 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:03.942724 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:03.942827 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:03.948151 (+ 5324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:37629: BlockingRecv error: recv got EOF from 127.17.18.66:37629 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:04.314146 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:04.303753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:47681)
0806 19:29:04.304396 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:04.304414 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:04.304561 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:04.304925 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:04.304930 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:04.305367 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:04.305590 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.305601 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.306645 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.306650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.307588 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.307602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.308365 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.308370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.308545 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.309179 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:04.309227 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:04.313843 (+ 4616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":356,"threads_started":1}
W20260806 19:29:04.314332 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:04.303896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:47681 (local address 127.17.18.126:40155)
0806 19:29:04.304179 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:04.304186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:04.304510 (+ 324us) server_negotiation.cc:407] Connection header received
0806 19:29:04.304697 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:04.304704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:04.304771 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:04.304858 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:04.305753 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.306493 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.307747 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.308179 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.308297 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.314096 (+ 5799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:47681: BlockingRecv error: recv got EOF from 127.17.18.65:47681 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:04.620524 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:04.605732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:59877)
0806 19:29:04.606512 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:04.606556 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:04.606768 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:04.607314 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:04.607319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:04.607981 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:04.608303 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.608325 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.609978 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.609998 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.611749 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.611781 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.613255 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.613266 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.613667 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.614777 (+ 1110us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:04.614817 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:04.620161 (+ 5344us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":425,"threads_started":1}
W20260806 19:29:04.620859 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:04.605827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:59877 (local address 127.17.18.126:40155)
0806 19:29:04.606168 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:04.606176 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:04.606711 (+ 535us) server_negotiation.cc:407] Connection header received
0806 19:29:04.606933 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:04.606937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:04.607047 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:04.607183 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:04.608505 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.609722 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.611985 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.612964 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.613205 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.620439 (+ 7234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:59877: BlockingRecv error: recv got EOF from 127.17.18.67:59877 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:04 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:04.966784 31179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:04.949657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:35815)
0806 19:29:04.950766 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:04.950808 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:04.951003 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:04.951531 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:04.951537 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:04.952359 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:04.952704 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.952716 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.954433 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.954447 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.955508 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:04.955531 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.956906 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.956921 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:04.957193 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.958340 (+ 1147us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:04.958408 (+ 68us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:04.966315 (+ 7907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":612,"threads_started":1}
W20260806 19:29:04.967135 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:04.949726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35815 (local address 127.17.18.126:40155)
0806 19:29:04.950190 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:04.950207 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:04.950986 (+ 779us) server_negotiation.cc:407] Connection header received
0806 19:29:04.951148 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:04.951152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:04.951299 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:04.951433 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:04.952890 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.954141 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.955751 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:04.956579 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:04.956813 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:04.966702 (+ 9889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:35815: BlockingRecv error: recv got EOF from 127.17.18.66:35815 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:05.330194 31181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:05.315562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:35205)
0806 19:29:05.316222 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:05.316241 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:05.316421 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:05.316935 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:05.316939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:05.317655 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:05.317914 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.317934 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.319516 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.319524 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.320956 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.320974 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.322296 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.322303 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.322521 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.323467 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:05.323506 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:05.329729 (+ 6223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":355,"threads_started":1}
W20260806 19:29:05.330376 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:05.315679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:35205 (local address 127.17.18.126:40155)
0806 19:29:05.316010 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:05.316021 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:05.316344 (+ 323us) server_negotiation.cc:407] Connection header received
0806 19:29:05.316600 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:05.316605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:05.316731 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:05.316865 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:05.318147 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.319299 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.321215 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.322075 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.322249 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.330073 (+ 7824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:35205: BlockingRecv error: recv got EOF from 127.17.18.65:35205 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:05.639175 31182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:05.622263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:33883)
0806 19:29:05.623234 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:05.623262 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:05.623474 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:05.624072 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:05.624078 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:05.624785 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:05.625102 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.625126 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.627638 (+ 2512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.627653 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.629009 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.629028 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.630743 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.630762 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.631106 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.632226 (+ 1120us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:05.632296 (+ 70us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:05.638703 (+ 6407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":780,"thread_start_us":533,"threads_started":1}
W20260806 19:29:05.640200 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:05.622458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:33883 (local address 127.17.18.126:40155)
0806 19:29:05.622876 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:05.622886 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:05.623409 (+ 523us) server_negotiation.cc:407] Connection header received
0806 19:29:05.623693 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:05.623702 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:05.623835 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:05.624037 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:05.625425 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.627326 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.629325 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.630393 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.630572 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.639147 (+ 8575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:33883: BlockingRecv error: recv got EOF from 127.17.18.67:33883 (error 108)
Metrics: {"server-negotiator.queue_time_us":167}
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:05 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:05.985562 31183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:05.968320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:58945)
0806 19:29:05.969126 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:05.969168 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:05.969352 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:05.970059 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:05.970065 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:05.971236 (+ 1171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:05.971554 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.971568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.973572 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.973578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.975242 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:05.975273 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.976903 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.976924 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:05.977368 (+ 444us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.978630 (+ 1262us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:05.978697 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:05.985089 (+ 6392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":373,"threads_started":1}
W20260806 19:29:05.986295 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:05.968598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:58945 (local address 127.17.18.126:40155)
0806 19:29:05.968867 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:05.968876 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:05.969265 (+ 389us) server_negotiation.cc:407] Connection header received
0806 19:29:05.969686 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:05.969692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:05.969837 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:05.969994 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:05.971914 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.973206 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.975555 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:05.976522 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:05.976815 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:05.985601 (+ 8786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:58945: BlockingRecv error: recv got EOF from 127.17.18.66:58945 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:06.347281 31184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:06.332223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:56981)
0806 19:29:06.333038 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:06.333065 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:06.333259 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:06.333881 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:06.333885 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:06.334492 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:06.334834 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.334846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.336378 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.336385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.337961 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.337998 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.339379 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.339392 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.339673 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:06.340933 (+ 1260us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:06.340978 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:06.346812 (+ 5834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":390,"threads_started":1}
W20260806 19:29:06.347733 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:06.332400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56981 (local address 127.17.18.126:40155)
0806 19:29:06.332729 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:06.332736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:06.333202 (+ 466us) server_negotiation.cc:407] Connection header received
0806 19:29:06.333506 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:06.333511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:06.333625 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:06.333771 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:06.335075 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.336148 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.338244 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.339142 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.339322 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:06.347293 (+ 7971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:56981: BlockingRecv error: recv got EOF from 127.17.18.65:56981 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.67@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:06.656332 31187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:06.641176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.67:50809)
0806 19:29:06.642106 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:06.642134 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:06.642379 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:06.642934 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:06.642941 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:06.643812 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:06.644135 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.644159 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.646059 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.646074 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.647931 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.647952 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.649177 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.649203 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.649447 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:06.650372 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:06.650414 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:06.655740 (+ 5326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":530,"threads_started":1}
W20260806 19:29:06.656680 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:06.641334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:50809 (local address 127.17.18.126:40155)
0806 19:29:06.641954 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:06.641963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:06.642271 (+ 308us) server_negotiation.cc:407] Connection header received
0806 19:29:06.642573 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:06.642588 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:06.642701 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:06.642850 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:06.644389 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.645801 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.648164 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.648907 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.649129 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:06.656200 (+ 7071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.67:50809: BlockingRecv error: recv got EOF from 127.17.18.67:50809 (error 108)
Metrics: {"server-negotiator.queue_time_us":353}
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:06 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.66@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:07.001876 31189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:06.987533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.66:60333)
0806 19:29:06.988238 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:06.988265 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:06.988449 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:06.988970 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:06.988979 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:06.989649 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:06.989967 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.989982 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.991537 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.991542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.993242 (+ 1700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:06.993261 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.994492 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.994509 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:06.994861 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:06.995849 (+ 988us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:06.995877 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:07.001308 (+ 5431us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":354,"threads_started":1}
W20260806 19:29:07.002235 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:06.987811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:60333 (local address 127.17.18.126:40155)
0806 19:29:06.988142 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:06.988156 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:06.988373 (+ 217us) server_negotiation.cc:407] Connection header received
0806 19:29:06.988643 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:06.988647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:06.988763 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:06.988903 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:06.990184 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.991292 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.993533 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:06.994226 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:06.994452 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.001834 (+ 7382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.66:60333: BlockingRecv error: recv got EOF from 127.17.18.66:60333 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 06 19:29:07 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 19:29:07 dist-test-slave-f0tn krb5kdc[29658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.18.65@KRBTEST.COM for oryx/127.17.18.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 19:29:07.358327 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:07.348588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40155 (local address 127.17.18.65:49253)
0806 19:29:07.349166 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:07.349182 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:07.349306 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:07.349631 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:07.349634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:07.350056 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:07.350239 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:07.350249 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.351731 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.351737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:07.352905 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:07.352921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.353728 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.353733 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:07.353864 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.354522 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:07.354542 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:07.358081 (+ 3539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.18.126:40155: Server oryx/127.17.18.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":309,"threads_started":1}
W20260806 19:29:07.358559 30768 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:07.348743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:49253 (local address 127.17.18.126:40155)
0806 19:29:07.348915 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:07.348919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:07.349255 (+ 336us) server_negotiation.cc:407] Connection header received
0806 19:29:07.349433 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:07.349437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:07.349506 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:07.349597 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:07.350417 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.351570 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.353056 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.353566 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.353668 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.358323 (+ 4655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.18.65:49253: BlockingRecv error: recv got EOF from 127.17.18.65:49253 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:29:07.412338 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30546
I20260806 19:29:07.425829 31193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:07.413602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36494 (local address 127.17.18.65:39547)
0806 19:29:07.414267 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:07.414274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:07.414305 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:29:07.414377 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:07.414384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:07.414619 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:07.414801 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:07.416293 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.417451 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.418772 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.419374 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.419488 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.422369 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:07.422381 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:07.422400 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:07.422448 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:07.425168 (+ 2720us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 19:29:07.425570 (+ 402us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36494: Request ticket server kudu/127.17.18.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":289,"threads_started":1}
W20260806 19:29:07.425938 31193 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36494: Request ticket server kudu/127.17.18.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 19:29:07.426074 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30546: Not authorized: Client connection negotiation failed: client connection to 127.17.18.65:39547: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 19:29:07.426295 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30546
I20260806 19:29:07.454835 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30770
I20260806 19:29:07.467760 31194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:07.455991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.17.18.66:38613)
0806 19:29:07.456699 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:07.456709 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:07.456746 (+ 37us) server_negotiation.cc:407] Connection header received
0806 19:29:07.456827 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:07.456836 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:07.457147 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:07.457407 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:07.458755 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.459844 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.461050 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.461769 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.461875 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.464375 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:07.464384 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:07.464400 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:07.464442 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:07.467198 (+ 2756us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 19:29:07.467510 (+ 312us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56938: Request ticket server kudu/127.17.18.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":301,"threads_started":1}
W20260806 19:29:07.467871 31194 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56938: Request ticket server kudu/127.17.18.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 19:29:07.468012 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30770: Not authorized: Client connection negotiation failed: client connection to 127.17.18.66:38613: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 19:29:07.468254 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30770
I20260806 19:29:07.492349 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30949
I20260806 19:29:07.506837 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:07.493552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.17.18.67:44537)
0806 19:29:07.494183 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:07.494190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:07.494217 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:29:07.494282 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:07.494289 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:07.494529 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:07.494738 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:07.496504 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.498164 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.499448 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:07.500353 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:07.500487 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:07.503326 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:07.503340 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:07.503362 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:07.503418 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:07.506263 (+ 2845us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 19:29:07.506581 (+ 318us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48178: Request ticket server kudu/127.17.18.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":305,"threads_started":1}
W20260806 19:29:07.506944 31195 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48178: Request ticket server kudu/127.17.18.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 19:29:07.507040 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30949: Not authorized: Client connection negotiation failed: client connection to 127.17.18.67:44537: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.17.18.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 19:29:07.507192 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30949
I20260806 19:29:07.535972 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 30438
I20260806 19:29:07.537514 30537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:07.660338 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 30438
2026-08-06T19:29:07Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22328 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T19:29:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:29:07Z Disabled control of system clock
I20260806 19:29:07.762828 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40241
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 19:29:08.124583 31200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:08.124907 31200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:08.125031 31200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:08.132704 31200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:29:08.132838 31200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:08.132881 31200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:08.132963 31200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:29:08.133024 31200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:29:08.142917 31200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40241
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:08.144326 31200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:08.146344 31200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:08.159842 31206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:08.159751 31209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:08.159786 31207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:08.160262 31200 server_base.cc:1034] running on GCE node
I20260806 19:29:08.161338 31200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:08.163057 31200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:08.164309 31200 hybrid_clock.cc:648] HybridClock initialized: now 1786044548164252 us; error 43 us; skew 500 ppm
I20260806 19:29:08.164745 31200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:08.171172 31200 webserver.cc:460] Webserver started at http://127.17.18.126:38747/ using document root <none> and password file <none>
I20260806 19:29:08.172036 31200 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:08.172148 31200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:08.172521 31200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:08.175980 31200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "6b2eebe5359e4c5da9f724102c5abb9f"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "5325018c9ab407c614ee8d17dce1a5dd"
server_key_iv: "39ac648ceaf8b7b2fb7b879df499a96c"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.176913 31200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "6b2eebe5359e4c5da9f724102c5abb9f"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "5325018c9ab407c614ee8d17dce1a5dd"
server_key_iv: "39ac648ceaf8b7b2fb7b879df499a96c"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.182865 31200 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 19:29:08.186892 31216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:08.188401 31200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:29:08.188603 31200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "6b2eebe5359e4c5da9f724102c5abb9f"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "5325018c9ab407c614ee8d17dce1a5dd"
server_key_iv: "39ac648ceaf8b7b2fb7b879df499a96c"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.188848 31200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:08.203064 31200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:08.204002 31200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:08.204306 31200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:08.223646 31200 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40241
I20260806 19:29:08.223670 31291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40241 every 8 connection(s)
I20260806 19:29:08.225183 31200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:29:08.229627 31292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:29:08.233882 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 31200
I20260806 19:29:08.234102 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:29:08.234786 17481 external_mini_cluster.cc:1428] Setting key 790f2ba6b09e2dec3ec4a73df6cb8ff7
I20260806 19:29:08.245294 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f: Bootstrap starting.
I20260806 19:29:08.249750 31292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:08.251251 31292 log.cc:824] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:08.251655 31299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:08.237135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47672 (local address 127.17.18.126:40241)
0806 19:29:08.238320 (+ 1185us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:08.238335 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:08.238396 (+ 61us) server_negotiation.cc:407] Connection header received
0806 19:29:08.240289 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:08.240329 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:08.241125 (+ 796us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:08.241697 (+ 572us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:08.242358 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.244369 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.245966 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.247031 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.247264 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:08.248521 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:08.248535 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:08.248557 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:08.249313 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:08.249477 (+ 164us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:08.249523 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:08.249664 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:08.249852 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 19:29:08.250248 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":383,"threads_started":1}
I20260806 19:29:08.254914 31292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f: No bootstrap required, opened a new log
I20260806 19:29:08.262699 31292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } }
I20260806 19:29:08.263121 31292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:08.263227 31292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2eebe5359e4c5da9f724102c5abb9f, State: Initialized, Role: FOLLOWER
I20260806 19:29:08.263841 31292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } }
I20260806 19:29:08.264063 31292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:29:08.264202 31292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:29:08.264372 31292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:08.266734 31292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } }
I20260806 19:29:08.267282 31292 leader_election.cc:302] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b2eebe5359e4c5da9f724102c5abb9f; no voters:
I20260806 19:29:08.267959 31292 leader_election.cc:288] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:29:08.268114 31303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:29:08.268864 31303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [term 1 LEADER]: Becoming Leader. State: Replica: 6b2eebe5359e4c5da9f724102c5abb9f, State: Running, Role: LEADER
I20260806 19:29:08.269515 31303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } }
I20260806 19:29:08.270234 31292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:29:08.272861 31305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b2eebe5359e4c5da9f724102c5abb9f. Latest consensus state: current_term: 1 leader_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } } }
I20260806 19:29:08.273310 31305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:08.273543 31304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b2eebe5359e4c5da9f724102c5abb9f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40241 } } }
I20260806 19:29:08.274252 31304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:08.277792 31315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:29:08.283025 31315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:29:08.292644 31315 catalog_manager.cc:1347] Generated new cluster ID: adbb5bbf729a4998a0af76c6853a7323
I20260806 19:29:08.292802 31315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:29:08.301946 31315 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:29:08.303968 31315 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:29:08.314594 31315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b2eebe5359e4c5da9f724102c5abb9f: Generated new TSK 0
I20260806 19:29:08.315534 31315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:29:08.331698 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--builtin_ntp_servers=127.17.18.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 19:29:08.705415 31332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:08.705767 31332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:08.705904 31332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:08.713524 31332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:08.713641 31332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:08.713792 31332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:29:08.723376 31332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:08.724819 31332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:08.726738 31332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:08.740284 31338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:08.740270 31337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:08.740278 31340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:08.741226 31332 server_base.cc:1034] running on GCE node
I20260806 19:29:08.741968 31332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:08.743011 31332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:08.744269 31332 hybrid_clock.cc:648] HybridClock initialized: now 1786044548744203 us; error 48 us; skew 500 ppm
I20260806 19:29:08.744639 31332 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:08.747046 31332 webserver.cc:460] Webserver started at http://127.17.18.65:39427/ using document root <none> and password file <none>
I20260806 19:29:08.747805 31332 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:08.747908 31332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:08.748229 31332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:08.751436 31332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "d60940736285464aae93e87f6f3c60f8"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "3c1116fdb365823e1fe626be3ddfaef2"
server_key_iv: "eab23452a4f4adeef89d8821490ce6e4"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.752285 31332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "d60940736285464aae93e87f6f3c60f8"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "3c1116fdb365823e1fe626be3ddfaef2"
server_key_iv: "eab23452a4f4adeef89d8821490ce6e4"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.757943 31332 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 19:29:08.761621 31346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:08.763064 31332 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:29:08.763247 31332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "d60940736285464aae93e87f6f3c60f8"
format_stamp: "Formatted at 2026-08-06 19:29:08 on dist-test-slave-f0tn"
server_key: "3c1116fdb365823e1fe626be3ddfaef2"
server_key_iv: "eab23452a4f4adeef89d8821490ce6e4"
server_key_version: "encryptionkey@0"
I20260806 19:29:08.763479 31332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:08.789234 31332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:08.790284 31332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:08.790609 31332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:08.791838 31332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:08.793556 31332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:08.793663 31332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:08.793776 31332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:08.793848 31332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:08.829195 31332 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:43113
I20260806 19:29:08.829269 31510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:43113 every 8 connection(s)
I20260806 19:29:08.830552 31332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:29:08.833287 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 31332
I20260806 19:29:08.833549 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:29:08.834235 17481 external_mini_cluster.cc:1428] Setting key 163b3cd7994fa81435cc0c9417f584d8
I20260806 19:29:08.837105 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--builtin_ntp_servers=127.17.18.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 19:29:08.844121 31514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:08.833169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:33261 (local address 127.17.18.126:40241)
0806 19:29:08.833748 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:08.833754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:08.835053 (+ 1299us) server_negotiation.cc:407] Connection header received
0806 19:29:08.837107 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:08.837113 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:08.837200 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:08.837320 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:08.838487 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.839441 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.841117 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.841708 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.841847 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:08.843285 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:08.843290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:08.843294 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:08.843317 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:08.843366 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:08.843380 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:08.843464 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:08.843677 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 19:29:08.843780 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":293,"threads_started":1}
I20260806 19:29:08.845156 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:08.833776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40241 (local address 127.17.18.65:33261)
0806 19:29:08.834879 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:08.834933 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:08.836825 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:08.837602 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:08.837610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:08.837713 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:08.838302 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:08.838319 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.839633 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.839637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:08.840950 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:08.840964 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:08.841979 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:08.841984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:08.842212 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:08.842936 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:08.842938 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:08.842983 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:08.843080 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:08.843470 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:08.843478 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:08.843485 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:29:08.843660 (+ 175us) client_negotiation.cc:240] Negotiation successful
0806 19:29:08.844000 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":349,"threads_started":1}
I20260806 19:29:08.846897 31512 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40241
I20260806 19:29:08.847227 31512 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:08.848061 31512 heartbeater.cc:511] Master 127.17.18.126:40241 requested a full tablet report, sending...
I20260806 19:29:08.850289 31240 ts_manager.cc:194] Registered new tserver with Master: d60940736285464aae93e87f6f3c60f8 (127.17.18.65:43113)
I20260806 19:29:08.851876 31240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.65:33261
W20260806 19:29:09.204612 31516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:09.204963 31516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:09.205082 31516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:09.212864 31516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:09.213021 31516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:09.213167 31516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:29:09.223097 31516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:09.224799 31516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:09.227161 31516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:09.242574 31526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:09.242753 31530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:09.242936 31525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:09.244505 31516 server_base.cc:1034] running on GCE node
I20260806 19:29:09.245241 31516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:09.246397 31516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:09.247630 31516 hybrid_clock.cc:648] HybridClock initialized: now 1786044549247573 us; error 50 us; skew 500 ppm
I20260806 19:29:09.247985 31516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:09.250509 31516 webserver.cc:460] Webserver started at http://127.17.18.66:42905/ using document root <none> and password file <none>
I20260806 19:29:09.251317 31516 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:09.251430 31516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:09.251776 31516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:09.254987 31516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "b4b1226883ad4ea8a677d0e7bf8dcad4"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "9a0d3cefdb6e04778db7aef45f884e55"
server_key_iv: "e54fd27f5b61e68094cd0a1c7c6bcbbf"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.255833 31516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "b4b1226883ad4ea8a677d0e7bf8dcad4"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "9a0d3cefdb6e04778db7aef45f884e55"
server_key_iv: "e54fd27f5b61e68094cd0a1c7c6bcbbf"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.261665 31516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260806 19:29:09.265826 31536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.267371 31516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 19:29:09.267561 31516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "b4b1226883ad4ea8a677d0e7bf8dcad4"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "9a0d3cefdb6e04778db7aef45f884e55"
server_key_iv: "e54fd27f5b61e68094cd0a1c7c6bcbbf"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.267796 31516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:09.281579 31516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:09.282584 31516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:09.282892 31516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:09.283932 31516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:09.285563 31516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:09.285656 31516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.285768 31516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:09.285836 31516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.318987 31516 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45601
I20260806 19:29:09.319059 31704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45601 every 8 connection(s)
I20260806 19:29:09.320439 31516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:29:09.329182 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 31516
I20260806 19:29:09.329406 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:29:09.329846 17481 external_mini_cluster.cc:1428] Setting key b02716c5f1442e5da79d84de75a2647f
I20260806 19:29:09.333042 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--builtin_ntp_servers=127.17.18.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 19:29:09.335206 31514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.323562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:57413 (local address 127.17.18.126:40241)
0806 19:29:09.323756 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:09.323760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:09.325337 (+ 1577us) server_negotiation.cc:407] Connection header received
0806 19:29:09.327507 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:09.327513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:09.327597 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:09.327814 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:09.329175 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.330100 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.332056 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.332559 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.332663 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.334425 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:09.334430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:09.334433 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:09.334453 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:09.334489 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:09.334500 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:09.334578 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:09.334841 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 19:29:09.334937 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 19:29:09.336759 31707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.324038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40241 (local address 127.17.18.66:57413)
0806 19:29:09.325147 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:09.325192 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:09.327159 (+ 1967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:09.328022 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:09.328031 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:09.328137 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:09.328937 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:09.328971 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.330288 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.330295 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:09.331909 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:09.331926 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.332834 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.332844 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:09.333196 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.333995 (+ 799us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:09.333999 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:09.334060 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:09.334178 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:09.334598 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:09.334609 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:09.334618 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 19:29:09.334829 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 19:29:09.335299 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":349,"threads_started":1}
I20260806 19:29:09.338418 31705 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40241
I20260806 19:29:09.338783 31705 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:09.339648 31705 heartbeater.cc:511] Master 127.17.18.126:40241 requested a full tablet report, sending...
I20260806 19:29:09.341348 31240 ts_manager.cc:194] Registered new tserver with Master: b4b1226883ad4ea8a677d0e7bf8dcad4 (127.17.18.66:45601)
I20260806 19:29:09.342280 31240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.66:57413
W20260806 19:29:09.693369 31708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:09.693782 31708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:09.693902 31708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:09.701333 31708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:09.701512 31708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:09.701659 31708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:29:09.711319 31708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:40241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:09.712692 31708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:09.714720 31708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:09.727928 31715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:09.727967 31719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:09.727990 31716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:09.728775 31708 server_base.cc:1034] running on GCE node
I20260806 19:29:09.729511 31708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:09.730548 31708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:09.731803 31708 hybrid_clock.cc:648] HybridClock initialized: now 1786044549731732 us; error 54 us; skew 500 ppm
I20260806 19:29:09.732193 31708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:09.734867 31708 webserver.cc:460] Webserver started at http://127.17.18.67:41065/ using document root <none> and password file <none>
I20260806 19:29:09.735680 31708 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:09.735795 31708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:09.736189 31708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:09.739377 31708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "6bbe5e9d3a07434b85ba825e9f707c7f"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "5e6483feb55fb8580ba29544d491ad6e"
server_key_iv: "6b7db8118f6380b33cdb788682c999da"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.740273 31708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "6bbe5e9d3a07434b85ba825e9f707c7f"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "5e6483feb55fb8580ba29544d491ad6e"
server_key_iv: "6b7db8118f6380b33cdb788682c999da"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.745954 31708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 19:29:09.749938 31729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.751369 31708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:29:09.751554 31708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "6bbe5e9d3a07434b85ba825e9f707c7f"
format_stamp: "Formatted at 2026-08-06 19:29:09 on dist-test-slave-f0tn"
server_key: "5e6483feb55fb8580ba29544d491ad6e"
server_key_iv: "6b7db8118f6380b33cdb788682c999da"
server_key_version: "encryptionkey@0"
I20260806 19:29:09.751781 31708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:09.769752 31708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:09.770748 31708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:09.771044 31708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:09.772121 31708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:09.773734 31708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:09.773837 31708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.773983 31708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:09.774047 31708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:09.806413 31708 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:39591
I20260806 19:29:09.806481 31893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:39591 every 8 connection(s)
I20260806 19:29:09.807897 31708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:29:09.816283 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 31708
I20260806 19:29:09.816509 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:29:09.817024 17481 external_mini_cluster.cc:1428] Setting key 744ea9d49f7592722188bf6efebb8744
I20260806 19:29:09.821655 31514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.810742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:42819 (local address 127.17.18.126:40241)
0806 19:29:09.810932 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:09.810937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:09.812529 (+ 1592us) server_negotiation.cc:407] Connection header received
0806 19:29:09.814445 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:09.814450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:09.814527 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:09.814631 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:09.815849 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.817042 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.818852 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.819264 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.819379 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.820778 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:09.820784 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:09.820787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:09.820806 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:09.820838 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:09.820849 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:09.820924 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:09.821161 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 19:29:09.821278 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:29:09.822824 31897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.811296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:40241 (local address 127.17.18.67:42819)
0806 19:29:09.812333 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:09.812388 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:09.814105 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:09.814880 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:09.814889 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:09.814984 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:09.815634 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:09.815652 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.817257 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.817262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:09.818676 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:09.818702 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.819527 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.819536 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:09.819772 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.820436 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:09.820439 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:09.820482 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:09.820573 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:09.820942 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:09.820955 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:09.820963 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:29:09.821136 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 19:29:09.821613 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":356,"threads_started":1}
I20260806 19:29:09.824180 31894 heartbeater.cc:347] Connected to a master server at 127.17.18.126:40241
I20260806 19:29:09.824524 31894 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:09.825414 31894 heartbeater.cc:511] Master 127.17.18.126:40241 requested a full tablet report, sending...
I20260806 19:29:09.827028 31240 ts_manager.cc:194] Registered new tserver with Master: 6bbe5e9d3a07434b85ba825e9f707c7f (127.17.18.67:39591)
I20260806 19:29:09.827858 31240 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.67:42819
I20260806 19:29:09.832571 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 19:29:09.838696 31514 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:09.837228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.17.18.126:40241)
0806 19:29:09.837493 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:09.837499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:09.837872 (+ 373us) server_negotiation.cc:407] Connection header received
0806 19:29:09.838003 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:09.838008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:09.838074 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:09.838160 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:09.838499 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47688: BlockingRecv error: recv got EOF from 127.0.0.1:47688 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:29:09.839294 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 31332
I20260806 19:29:09.847126 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.840366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.17.18.65:43113)
0806 19:29:09.840912 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:09.840919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:09.840945 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:29:09.840999 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:09.841005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:09.841245 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:09.841370 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:09.841810 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.842821 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.844042 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.844619 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.844727 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.845757 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:09.845766 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:09.845781 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:09.846421 (+ 640us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:09.846472 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:09.846494 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:09.846592 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:09.846684 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 19:29:09.846804 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":254,"threads_started":1}
I20260806 19:29:09.848444 31504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:09.931886 31512 heartbeater.cc:503] Master 127.17.18.126:40241 was elected leader, sending a full tablet report...
I20260806 19:29:09.933219 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 31332
W20260806 19:29:09.961257 31220 connection.cc:535] server connection from 127.17.18.65:33261 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 19:29:09.961510 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 31516
I20260806 19:29:09.972604 31910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:09.962519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60388 (local address 127.17.18.66:45601)
0806 19:29:09.963078 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:09.963088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:09.963126 (+ 38us) server_negotiation.cc:407] Connection header received
0806 19:29:09.963209 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:09.963217 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:09.963448 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:09.963588 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:09.963938 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.964928 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.966353 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:09.966962 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:09.967121 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:09.970916 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:09.970931 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:09.970952 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:09.971671 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:09.971729 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:09.971754 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:09.971867 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:09.972027 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 19:29:09.972213 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":261,"threads_started":1}
I20260806 19:29:09.974012 31698 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:10.059167 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 31516
I20260806 19:29:10.086345 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 31708
I20260806 19:29:10.095436 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:10.087429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39670 (local address 127.17.18.67:39591)
0806 19:29:10.088064 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:10.088072 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:10.088103 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:29:10.088196 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:10.088204 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:10.088429 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:10.088594 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:10.089084 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:10.090248 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:10.091576 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:10.092205 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:10.092333 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:10.093803 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:10.093813 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:10.093832 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:10.094514 (+ 682us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:10.094575 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:10.094598 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:10.094713 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:10.094889 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 19:29:10.095080 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":321,"threads_started":1}
I20260806 19:29:10.096798 31884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:10.184705 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 31708
I20260806 19:29:10.216887 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 31200
I20260806 19:29:10.218560 31287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:10.330659 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 31200
2026-08-06T19:29:10Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2662 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T19:29:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:29:10Z Disabled control of system clock
I20260806 19:29:10.426851 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43611
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 19:29:10.796598 31919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:10.796932 31919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:10.797032 31919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:10.804806 31919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:29:10.804978 31919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:10.805043 31919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:10.805124 31919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:29:10.805186 31919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:29:10.815495 31919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:10.816980 31919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:10.818977 31919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:10.832010 31927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:10.832463 31928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:10.832608 31931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:10.832934 31919 server_base.cc:1034] running on GCE node
I20260806 19:29:10.833860 31919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:10.835451 31919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:10.836680 31919 hybrid_clock.cc:648] HybridClock initialized: now 1786044550836633 us; error 45 us; skew 500 ppm
I20260806 19:29:10.837059 31919 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:10.839821 31919 webserver.cc:460] Webserver started at http://127.17.18.126:40349/ using document root <none> and password file <none>
I20260806 19:29:10.840610 31919 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:10.840727 31919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:10.841064 31919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:10.844327 31919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "9129faea621647ad8863f3035c6bd062"
format_stamp: "Formatted at 2026-08-06 19:29:10 on dist-test-slave-f0tn"
server_key: "cdb22239642bebf76d02a45105326cbe"
server_key_iv: "7606a8ec884e22e4b7737e69ecda2777"
server_key_version: "encryptionkey@0"
I20260806 19:29:10.845197 31919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "9129faea621647ad8863f3035c6bd062"
format_stamp: "Formatted at 2026-08-06 19:29:10 on dist-test-slave-f0tn"
server_key: "cdb22239642bebf76d02a45105326cbe"
server_key_iv: "7606a8ec884e22e4b7737e69ecda2777"
server_key_version: "encryptionkey@0"
I20260806 19:29:10.851040 31919 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 19:29:10.855031 31939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:10.856653 31919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:29:10.856841 31919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "9129faea621647ad8863f3035c6bd062"
format_stamp: "Formatted at 2026-08-06 19:29:10 on dist-test-slave-f0tn"
server_key: "cdb22239642bebf76d02a45105326cbe"
server_key_iv: "7606a8ec884e22e4b7737e69ecda2777"
server_key_version: "encryptionkey@0"
I20260806 19:29:10.857076 31919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:10.863600 31919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:10.864554 31919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:10.864876 31919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:10.884166 31919 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43611
I20260806 19:29:10.884203 32017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43611 every 8 connection(s)
I20260806 19:29:10.885654 31919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:29:10.887604 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 31919
I20260806 19:29:10.887843 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:29:10.888674 17481 external_mini_cluster.cc:1428] Setting key e79808134e01c1dd47288e7b2f184694
I20260806 19:29:10.890667 32018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:29:10.897586 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:10.890899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.17.18.126:43611)
0806 19:29:10.891971 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:10.891982 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:10.892026 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:29:10.893720 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:10.893745 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:10.894204 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:10.894557 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:10.895774 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:10.895781 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:10.895795 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:10.895811 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:10.895919 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:10.895937 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:10.896114 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:10.896226 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 19:29:10.896519 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":409,"threads_started":1}
I20260806 19:29:10.904183 32018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062: Bootstrap starting.
I20260806 19:29:10.907869 32018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:10.909018 32018 log.cc:824] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:10.912418 32018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062: No bootstrap required, opened a new log
I20260806 19:29:10.920410 32018 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } }
I20260806 19:29:10.920859 32018 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:10.920958 32018 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9129faea621647ad8863f3035c6bd062, State: Initialized, Role: FOLLOWER
I20260806 19:29:10.921639 32018 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } }
I20260806 19:29:10.921954 32018 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:29:10.922106 32018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:29:10.922286 32018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:10.925022 32018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } }
I20260806 19:29:10.925652 32018 leader_election.cc:302] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9129faea621647ad8863f3035c6bd062; no voters:
I20260806 19:29:10.926285 32018 leader_election.cc:288] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:29:10.926457 32025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:29:10.927189 32025 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [term 1 LEADER]: Becoming Leader. State: Replica: 9129faea621647ad8863f3035c6bd062, State: Running, Role: LEADER
I20260806 19:29:10.927806 32025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } }
I20260806 19:29:10.928491 32018 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:29:10.930562 32027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9129faea621647ad8863f3035c6bd062. Latest consensus state: current_term: 1 leader_uuid: "9129faea621647ad8863f3035c6bd062" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } } }
I20260806 19:29:10.930998 32027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:10.930809 32026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9129faea621647ad8863f3035c6bd062" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9129faea621647ad8863f3035c6bd062" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43611 } } }
I20260806 19:29:10.931103 32026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062 [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:10.932542 32036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:29:10.938191 32036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:29:10.947815 32036 catalog_manager.cc:1347] Generated new cluster ID: 592398b79371430c9fa17bee1e62bb30
I20260806 19:29:10.947962 32036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:29:10.963950 32036 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:29:10.964526 32036 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:29:10.978528 32036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9129faea621647ad8863f3035c6bd062: Generated new TSK 0
I20260806 19:29:10.979777 32036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:29:10.986593 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--builtin_ntp_servers=127.17.18.84:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 19:29:11.379563 32054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:11.379880 32054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:11.380004 32054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:11.387840 32054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:11.387974 32054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:11.388130 32054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:29:11.398236 32054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:11.399638 32054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:11.402165 32054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:11.416859 32062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:11.416903 32065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:11.417637 32061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:11.417848 32054 server_base.cc:1034] running on GCE node
I20260806 19:29:11.418565 32054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:11.419613 32054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:11.420838 32054 hybrid_clock.cc:648] HybridClock initialized: now 1786044551420784 us; error 38 us; skew 500 ppm
I20260806 19:29:11.421245 32054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:11.424115 32054 webserver.cc:460] Webserver started at http://127.17.18.65:36963/ using document root <none> and password file <none>
I20260806 19:29:11.424911 32054 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:11.425010 32054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:11.425345 32054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:11.428639 32054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "5c230ebe34b84a7297bfd04394f5b55d"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "44bb486afd687de2fad8297087d33975"
server_key_iv: "b1c92cc8dc95a49e41b27cd06a113a45"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.429550 32054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "5c230ebe34b84a7297bfd04394f5b55d"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "44bb486afd687de2fad8297087d33975"
server_key_iv: "b1c92cc8dc95a49e41b27cd06a113a45"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.435338 32054 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 19:29:11.439245 32072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.440732 32054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 19:29:11.440903 32054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5c230ebe34b84a7297bfd04394f5b55d"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "44bb486afd687de2fad8297087d33975"
server_key_iv: "b1c92cc8dc95a49e41b27cd06a113a45"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.441129 32054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:11.447403 32054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:11.448266 32054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:11.448562 32054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:11.449523 32054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:11.450992 32054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:11.451082 32054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.451184 32054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:11.451241 32054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.484812 32054 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:39841
I20260806 19:29:11.484898 32246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:39841 every 8 connection(s)
I20260806 19:29:11.486322 32054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:29:11.489620 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 32054
I20260806 19:29:11.489851 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:29:11.490698 17481 external_mini_cluster.cc:1428] Setting key 6e916240d74257c8d0f2035aadf9135f
I20260806 19:29:11.493572 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--builtin_ntp_servers=127.17.18.84:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 19:29:11.495720 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:11.489238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:44819 (local address 127.17.18.126:43611)
0806 19:29:11.489753 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:11.489759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:11.491419 (+ 1660us) server_negotiation.cc:407] Connection header received
0806 19:29:11.493235 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:11.493241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:11.493312 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:11.493435 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:11.494901 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:11.494907 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:11.494912 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:11.494931 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:11.494977 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:11.494989 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:11.495106 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:11.495308 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 19:29:11.495384 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":279,"threads_started":1}
I20260806 19:29:11.496788 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:11.490059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43611 (local address 127.17.18.65:44819)
0806 19:29:11.491206 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:11.491258 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:11.492930 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:11.493715 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:11.493727 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:11.493855 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:11.494560 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:11.494563 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:11.494607 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:11.494707 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:11.495086 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:11.495097 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:11.495105 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:29:11.495390 (+ 285us) client_negotiation.cc:240] Negotiation successful
0806 19:29:11.495703 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":367,"threads_started":1}
I20260806 19:29:11.498694 32247 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43611
I20260806 19:29:11.499050 32247 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:11.499732 32247 heartbeater.cc:511] Master 127.17.18.126:43611 requested a full tablet report, sending...
I20260806 19:29:11.502588 31964 ts_manager.cc:194] Registered new tserver with Master: 5c230ebe34b84a7297bfd04394f5b55d (127.17.18.65:39841)
W20260806 19:29:11.863940 32254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:11.864308 32254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:11.864451 32254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:11.872308 32254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:11.872463 32254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:11.872619 32254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:29:11.882429 32254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:11.883965 32254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:11.885951 32254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:11.901614 32263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:11.901646 32266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:11.901590 32264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:11.902705 32254 server_base.cc:1034] running on GCE node
I20260806 19:29:11.903383 32254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:11.904469 32254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:11.905676 32254 hybrid_clock.cc:648] HybridClock initialized: now 1786044551905625 us; error 45 us; skew 500 ppm
I20260806 19:29:11.906023 32254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:11.908428 32254 webserver.cc:460] Webserver started at http://127.17.18.66:36465/ using document root <none> and password file <none>
I20260806 19:29:11.909178 32254 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:11.909302 32254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:11.909659 32254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:11.912735 32254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "53068b6a79014c99aee940456ee35eb4"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "d3368f202847ebec07a292099bfa488d"
server_key_iv: "5fd028276faf4385e9eccc91d5bdb822"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.913686 32254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "53068b6a79014c99aee940456ee35eb4"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "d3368f202847ebec07a292099bfa488d"
server_key_iv: "5fd028276faf4385e9eccc91d5bdb822"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.919513 32254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:29:11.923326 32276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.924779 32254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:29:11.924965 32254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "53068b6a79014c99aee940456ee35eb4"
format_stamp: "Formatted at 2026-08-06 19:29:11 on dist-test-slave-f0tn"
server_key: "d3368f202847ebec07a292099bfa488d"
server_key_iv: "5fd028276faf4385e9eccc91d5bdb822"
server_key_version: "encryptionkey@0"
I20260806 19:29:11.925216 32254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:11.931525 32254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:11.932507 32254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:11.932825 32254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:11.933938 32254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:11.935565 32254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:11.935678 32254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.935796 32254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:11.935869 32254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:11.967478 32254 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:33315
I20260806 19:29:11.967554 32437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:33315 every 8 connection(s)
I20260806 19:29:11.968873 32254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:29:11.976305 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 32254
I20260806 19:29:11.976503 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:29:11.977073 17481 external_mini_cluster.cc:1428] Setting key f91ca50a026dc1c62d88b823b1d062a7
I20260806 19:29:11.977906 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:11.971553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:40225 (local address 127.17.18.126:43611)
0806 19:29:11.971767 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:11.971773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:11.973314 (+ 1541us) server_negotiation.cc:407] Connection header received
0806 19:29:11.975188 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:11.975193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:11.975256 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:11.975353 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:11.977020 (+ 1667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:11.977025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:11.977029 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:11.977057 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:11.977095 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:11.977108 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:11.977267 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:11.977529 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 19:29:11.977613 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:29:11.979240 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:11.972145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43611 (local address 127.17.18.66:40225)
0806 19:29:11.973133 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:11.973173 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:11.974823 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:11.975577 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:11.975586 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:11.975691 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:11.976556 (+ 865us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:11.976559 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:11.976622 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:11.976774 (+ 152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:11.977244 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:11.977258 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:11.977267 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 19:29:11.977632 (+ 365us) client_negotiation.cc:240] Negotiation successful
0806 19:29:11.977951 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":294,"threads_started":1}
I20260806 19:29:11.980305 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--builtin_ntp_servers=127.17.18.84:34867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 19:29:11.980731 32438 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43611
I20260806 19:29:11.981089 32438 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:11.981932 32438 heartbeater.cc:511] Master 127.17.18.126:43611 requested a full tablet report, sending...
I20260806 19:29:11.983721 31964 ts_manager.cc:194] Registered new tserver with Master: 53068b6a79014c99aee940456ee35eb4 (127.17.18.66:33315)
W20260806 19:29:12.350620 32441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:12.350965 32441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:12.351086 32441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:12.358937 32441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:12.359076 32441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:12.359230 32441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:29:12.369246 32441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43611
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:12.370872 32441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:12.372952 32441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:12.387974 32448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:12.387876 32447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:12.387876 32452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:12.390075 32441 server_base.cc:1034] running on GCE node
I20260806 19:29:12.390820 32441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:12.391930 32441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:12.393177 32441 hybrid_clock.cc:648] HybridClock initialized: now 1786044552393119 us; error 46 us; skew 500 ppm
I20260806 19:29:12.393615 32441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:29:12.396222 32441 webserver.cc:460] Webserver started at http://127.17.18.67:45957/ using document root <none> and password file <none>
I20260806 19:29:12.397023 32441 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:12.397128 32441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:12.397503 32441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:12.400727 32441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "a146bd3aa3e6423b824fba372ef4b156"
format_stamp: "Formatted at 2026-08-06 19:29:12 on dist-test-slave-f0tn"
server_key: "fa460a0ae28f065fe4ee5c93a0f96aca"
server_key_iv: "5477372a9fba264d2564773af4bfd504"
server_key_version: "encryptionkey@0"
I20260806 19:29:12.401751 32441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "a146bd3aa3e6423b824fba372ef4b156"
format_stamp: "Formatted at 2026-08-06 19:29:12 on dist-test-slave-f0tn"
server_key: "fa460a0ae28f065fe4ee5c93a0f96aca"
server_key_iv: "5477372a9fba264d2564773af4bfd504"
server_key_version: "encryptionkey@0"
I20260806 19:29:12.408133 32441 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 19:29:12.412322 32459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:12.414088 32441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:29:12.414283 32441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "a146bd3aa3e6423b824fba372ef4b156"
format_stamp: "Formatted at 2026-08-06 19:29:12 on dist-test-slave-f0tn"
server_key: "fa460a0ae28f065fe4ee5c93a0f96aca"
server_key_iv: "5477372a9fba264d2564773af4bfd504"
server_key_version: "encryptionkey@0"
I20260806 19:29:12.414522 32441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:12.420986 32441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:12.421985 32441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:12.422272 32441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:12.423355 32441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:12.425019 32441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:12.425129 32441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:12.425242 32441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:12.425316 32441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:12.459143 32441 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:42683
I20260806 19:29:12.459263 32638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:42683 every 8 connection(s)
I20260806 19:29:12.460598 32441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:29:12.464326 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 32441
I20260806 19:29:12.464547 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:29:12.465139 17481 external_mini_cluster.cc:1428] Setting key d06c2020c8a52c75cec476b98ad340e0
I20260806 19:29:12.470563 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:12.463416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:36407 (local address 127.17.18.126:43611)
0806 19:29:12.463604 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:12.463609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:12.465372 (+ 1763us) server_negotiation.cc:407] Connection header received
0806 19:29:12.467783 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:12.467788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:12.467863 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:12.467997 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:12.469713 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:12.469718 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:12.469721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:12.469740 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:12.469775 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:12.469788 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:12.469885 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:12.470215 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 19:29:12.470277 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 19:29:12.471586 32641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:12.463948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43611 (local address 127.17.18.67:36407)
0806 19:29:12.465160 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:12.465224 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:12.467435 (+ 2211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:12.468390 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:12.468403 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:12.468547 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:12.469334 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:29:12.469336 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:12.469412 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:29:12.469534 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:12.469916 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:12.469927 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:12.469934 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:29:12.470248 (+ 314us) client_negotiation.cc:240] Negotiation successful
0806 19:29:12.470496 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":326,"threads_started":1}
I20260806 19:29:12.473110 32639 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43611
I20260806 19:29:12.473498 32639 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:12.474196 32639 heartbeater.cc:511] Master 127.17.18.126:43611 requested a full tablet report, sending...
I20260806 19:29:12.475813 31964 ts_manager.cc:194] Registered new tserver with Master: a146bd3aa3e6423b824fba372ef4b156 (127.17.18.67:42683)
I20260806 19:29:12.481244 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 19:29:12.487867 32252 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:29:12.486242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53496 (local address 127.17.18.126:43611)
0806 19:29:12.486436 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:12.486443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:12.486922 (+ 479us) server_negotiation.cc:407] Connection header received
0806 19:29:12.487054 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:12.487059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:12.487131 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:12.487244 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:12.487593 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53496: BlockingRecv error: recv got EOF from 127.0.0.1:53496 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:29:12.488423 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 32054
I20260806 19:29:12.492818 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:12.489660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33276 (local address 127.17.18.65:39841)
0806 19:29:12.490370 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:12.490380 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:12.490413 (+ 33us) server_negotiation.cc:407] Connection header received
0806 19:29:12.490482 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:12.490490 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:12.490771 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:12.490952 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:12.492097 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:12.492104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:12.492118 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:12.492130 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:12.492178 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:12.492193 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:12.492337 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:12.492391 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 19:29:12.492484 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":350,"threads_started":1}
I20260806 19:29:12.494202 32241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:12.580888 32247 heartbeater.cc:503] Master 127.17.18.126:43611 was elected leader, sending a full tablet report...
I20260806 19:29:12.582608 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 32054
W20260806 19:29:12.613761 31940 connection.cc:535] server connection from 127.17.18.65:44819 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 19:29:12.613961 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 32254
I20260806 19:29:12.617539 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:12.615013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50986 (local address 127.17.18.66:33315)
0806 19:29:12.615543 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:12.615559 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:12.615587 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:29:12.615650 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:12.615658 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:12.615901 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:12.616032 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:12.616848 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:12.616855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:12.616868 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:12.616887 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:12.616928 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:12.616943 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:12.617047 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:12.617102 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 19:29:12.617184 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":248,"threads_started":1}
I20260806 19:29:12.618836 32433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:12.705341 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 32254
I20260806 19:29:12.732878 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 32441
I20260806 19:29:12.737205 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:12.733909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.17.18.67:42683)
0806 19:29:12.734608 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:12.734615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:12.734652 (+ 37us) server_negotiation.cc:407] Connection header received
0806 19:29:12.734727 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:12.734734 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:12.734959 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:12.735137 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:12.736380 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:12.736387 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:12.736400 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:29:12.736421 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:12.736466 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:29:12.736491 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:12.736668 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:12.736760 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 19:29:12.736868 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":341,"threads_started":1}
I20260806 19:29:12.738603 32633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:12.821835 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 32441
I20260806 19:29:12.844568 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 31919
I20260806 19:29:12.845914 32011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:12.955004 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 31919
2026-08-06T19:29:12Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2625 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:29:13 dist-test-slave-f0tn krb5kdc[32663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:29:13 dist-test-slave-f0tn krb5kdc[32663](info): set up 2 sockets
Aug 06 19:29:13 dist-test-slave-f0tn krb5kdc[32663](info): commencing operation
krb5kdc: starting...
W20260806 19:29:14.199652 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.007s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:29:14 dist-test-slave-f0tn krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:29:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:29:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:29:14.518674 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:33533
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:33533
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:29:14.888378 32680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:14.888739 32680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:14.888882 32680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:14.896528 32680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:29:14.896689 32680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:14.896765 32680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:14.896852 32680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:29:14.896919 32680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:29:14.907584 32680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:33533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:33533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:14.909108 32680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:14.910533 32680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:14.923000 32689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:14.923111 32693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:14.923105 32690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:14.924383 32680 server_base.cc:1034] running on GCE node
I20260806 19:29:14.925294 32680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:14.926935 32680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:14.928205 32680 hybrid_clock.cc:648] HybridClock initialized: now 1786044554928150 us; error 42 us; skew 500 ppm
I20260806 19:29:14.928633 32680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:29:14 dist-test-slave-f0tn krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:29:14.936509 32680 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:29:14.938367 32680 webserver.cc:460] Webserver started at http://127.17.18.126:42667/ using document root <none> and password file <none>
I20260806 19:29:14.939123 32680 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:14.939244 32680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:14.939565 32680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:14.942940 32680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "e791c24b236b4024b5dfcb34ca6d9fce"
format_stamp: "Formatted at 2026-08-06 19:29:14 on dist-test-slave-f0tn"
server_key: "18a96dd1ac26cc0a1261c7a7a1ae57ab"
server_key_iv: "f67f97b4e8980fcde8ff19ba2fb50c7e"
server_key_version: "encryptionkey@0"
I20260806 19:29:14.943794 32680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "e791c24b236b4024b5dfcb34ca6d9fce"
format_stamp: "Formatted at 2026-08-06 19:29:14 on dist-test-slave-f0tn"
server_key: "18a96dd1ac26cc0a1261c7a7a1ae57ab"
server_key_iv: "f67f97b4e8980fcde8ff19ba2fb50c7e"
server_key_version: "encryptionkey@0"
I20260806 19:29:14.949970 32680 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:29:14.953948 32704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:14.955497 32680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:29:14.955713 32680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "e791c24b236b4024b5dfcb34ca6d9fce"
format_stamp: "Formatted at 2026-08-06 19:29:14 on dist-test-slave-f0tn"
server_key: "18a96dd1ac26cc0a1261c7a7a1ae57ab"
server_key_iv: "f67f97b4e8980fcde8ff19ba2fb50c7e"
server_key_version: "encryptionkey@0"
I20260806 19:29:14.955930 32680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:14.972633 32680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:14.977344 32680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:14.977708 32680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:14.996536 32680 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:33533
I20260806 19:29:14.996572 312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:33533 every 8 connection(s)
I20260806 19:29:14.998199 32680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:29:15.000670 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 32680
I20260806 19:29:15.000905 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:29:15.001803 17481 external_mini_cluster.cc:1428] Setting key 328347fb860ce620384bed8d8b847d81
I20260806 19:29:15.003306 314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:29:15 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:29:15.016582 314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: Bootstrap starting.
I20260806 19:29:15.020454 314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:15.021662 314 log.cc:824] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:15.025460 314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: No bootstrap required, opened a new log
I20260806 19:29:15.025931 317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:15.004101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.17.18.126:33533)
0806 19:29:15.004967 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:15.004980 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:15.005025 (+ 45us) server_negotiation.cc:407] Connection header received
0806 19:29:15.006806 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:15.006834 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:15.007317 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:15.007732 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:15.009358 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.010777 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.012112 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.013095 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.013344 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:15.017815 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:15.017825 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:15.017844 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:15.017892 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:15.021231 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:15.022129 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:15.022137 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:15.022144 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:15.022391 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:15.022842 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:15.022847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:15.022854 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:15.023542 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:15.023813 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:15.024323 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 19:29:15.024689 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":374,"threads_started":1}
I20260806 19:29:15.034252 314 raft_consensus.cc:348] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } }
I20260806 19:29:15.034687 314 raft_consensus.cc:374] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:15.034793 314 raft_consensus.cc:729] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e791c24b236b4024b5dfcb34ca6d9fce, State: Initialized, Role: FOLLOWER
I20260806 19:29:15.035446 314 consensus_queue.cc:260] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } }
I20260806 19:29:15.035698 314 raft_consensus.cc:388] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:29:15.035835 314 raft_consensus.cc:482] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:29:15.036007 314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:15.038667 314 raft_consensus.cc:504] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } }
I20260806 19:29:15.039233 314 leader_election.cc:302] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e791c24b236b4024b5dfcb34ca6d9fce; no voters:
I20260806 19:29:15.039914 314 leader_election.cc:288] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:29:15.040031 319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:29:15.040760 319 raft_consensus.cc:686] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [term 1 LEADER]: Becoming Leader. State: Replica: e791c24b236b4024b5dfcb34ca6d9fce, State: Running, Role: LEADER
I20260806 19:29:15.041397 319 consensus_queue.cc:237] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } }
I20260806 19:29:15.042310 314 sys_catalog.cc:564] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:29:15.044906 320 sys_catalog.cc:455] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } } }
I20260806 19:29:15.045212 322 sys_catalog.cc:455] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [sys.catalog]: SysCatalogTable state changed. Reason: New leader e791c24b236b4024b5dfcb34ca6d9fce. Latest consensus state: current_term: 1 leader_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e791c24b236b4024b5dfcb34ca6d9fce" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 33533 } } }
I20260806 19:29:15.045467 320 sys_catalog.cc:458] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:15.045522 322 sys_catalog.cc:458] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce [sys.catalog]: This master's current role is: LEADER
I20260806 19:29:15.054538 328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:29:15.061031 328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:29:15.072111 328 catalog_manager.cc:1347] Generated new cluster ID: 75d87dce553d44b0aae1496b4cd43dbc
I20260806 19:29:15.072258 328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:29:15.086063 328 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:29:15.087558 328 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:29:15.094430 328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: Generated new TSK 0
I20260806 19:29:15.095455 328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:29:15.169721 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:29:15.544613 347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:15.544911 347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:15.545019 347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:15.552582 347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:15.552743 347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:15.552870 347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:29:15.563895 347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:15.565414 347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:15.566871 347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:15.581702 355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:15.581728 359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:15.581770 356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:15.582974 347 server_base.cc:1034] running on GCE node
I20260806 19:29:15.583753 347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:15.584882 347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:15.586128 347 hybrid_clock.cc:648] HybridClock initialized: now 1786044555586058 us; error 59 us; skew 500 ppm
I20260806 19:29:15.586521 347 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:29:15 dist-test-slave-f0tn krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044555, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:29:15.590202 347 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:29:15.591956 347 webserver.cc:460] Webserver started at http://127.17.18.65:38535/ using document root <none> and password file <none>
I20260806 19:29:15.592748 347 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:15.592888 347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:15.593274 347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:15.596756 347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "42ba4e9a0cff4e54982e7b8c274c3a51"
format_stamp: "Formatted at 2026-08-06 19:29:15 on dist-test-slave-f0tn"
server_key: "d9af2de009c0fb51f789de400c7e5e04"
server_key_iv: "1ac5c3fcbf35edb2f65f8441580fa63b"
server_key_version: "encryptionkey@0"
I20260806 19:29:15.597630 347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "42ba4e9a0cff4e54982e7b8c274c3a51"
format_stamp: "Formatted at 2026-08-06 19:29:15 on dist-test-slave-f0tn"
server_key: "d9af2de009c0fb51f789de400c7e5e04"
server_key_iv: "1ac5c3fcbf35edb2f65f8441580fa63b"
server_key_version: "encryptionkey@0"
I20260806 19:29:15.603502 347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:29:15.607708 368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:15.609485 347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:29:15.609687 347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "42ba4e9a0cff4e54982e7b8c274c3a51"
format_stamp: "Formatted at 2026-08-06 19:29:15 on dist-test-slave-f0tn"
server_key: "d9af2de009c0fb51f789de400c7e5e04"
server_key_iv: "1ac5c3fcbf35edb2f65f8441580fa63b"
server_key_version: "encryptionkey@0"
I20260806 19:29:15.609910 347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:15.645036 347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:15.649717 347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:15.650029 347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:15.651099 347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:15.652689 347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:15.652767 347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:15.652896 347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:15.652949 347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:15.686275 347 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:41495
I20260806 19:29:15.686327 543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:41495 every 8 connection(s)
I20260806 19:29:15.687675 347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:29:15.692883 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 347
I20260806 19:29:15.693095 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:29:15.693800 17481 external_mini_cluster.cc:1428] Setting key f38507ca23ead17bdda3f46a2654742e
Aug 06 19:29:15 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044555, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:29:15.710608 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:15.690538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:40419 (local address 127.17.18.126:33533)
0806 19:29:15.691027 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:15.691032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:15.692234 (+ 1202us) server_negotiation.cc:407] Connection header received
0806 19:29:15.694358 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:15.694364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:15.694451 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:15.694570 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:15.696625 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.697692 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.699389 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.699897 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.700021 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:15.703877 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:15.703884 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:15.703889 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:15.703932 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:15.707015 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:15.708006 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:15.708011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:15.708014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:15.708180 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:15.708632 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:15.708636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:15.708639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:15.708971 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:15.709100 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:15.710126 (+ 1026us) server_negotiation.cc:299] Negotiation successful
0806 19:29:15.710327 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":250,"threads_started":1}
I20260806 19:29:15.712097 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:15.691053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:33533 (local address 127.17.18.65:40419)
0806 19:29:15.691992 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:15.692042 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:15.694022 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:15.694853 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:15.694867 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:15.695680 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:15.696423 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:15.696445 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.697849 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.697854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:15.699183 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:15.699231 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:15.700120 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:15.700125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:15.700362 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:15.701037 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:15.701068 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:15.703600 (+ 2532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:15.707238 (+ 3638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:15.707248 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:15.707270 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:15.707863 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:15.708280 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:15.708284 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:15.708288 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:15.708523 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:15.709116 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:15.709125 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:15.709651 (+ 526us) client_negotiation.cc:769] Sending connection context
0806 19:29:15.710015 (+ 364us) client_negotiation.cc:240] Negotiation successful
0806 19:29:15.710619 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":366,"threads_started":1}
I20260806 19:29:15.713965 545 heartbeater.cc:347] Connected to a master server at 127.17.18.126:33533
I20260806 19:29:15.714349 545 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:15.715232 545 heartbeater.cc:511] Master 127.17.18.126:33533 requested a full tablet report, sending...
I20260806 19:29:15.717911 32727 ts_manager.cc:194] Registered new tserver with Master: 42ba4e9a0cff4e54982e7b8c274c3a51 (127.17.18.65:41495)
I20260806 19:29:15.720023 32727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:40419
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:29:15.765472 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:29:16.139288 555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:16.139608 555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:16.139740 555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:16.147511 555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:16.147643 555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:16.147770 555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:29:16.158582 555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:16.160079 555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:16.161633 555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:16.176363 565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:16.176487 563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:16.176672 567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:16.177212 555 server_base.cc:1034] running on GCE node
I20260806 19:29:16.177946 555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:16.179033 555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:16.180284 555 hybrid_clock.cc:648] HybridClock initialized: now 1786044556180236 us; error 47 us; skew 500 ppm
I20260806 19:29:16.180660 555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:29:16 dist-test-slave-f0tn krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:29:16.184234 555 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:29:16.186100 555 webserver.cc:460] Webserver started at http://127.17.18.66:39309/ using document root <none> and password file <none>
I20260806 19:29:16.186884 555 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:16.187018 555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:16.187353 555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:16.190723 555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "3af66155e66d498bb453a969b2cab0b9"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "3c4624c2f4fcb37809ff8a4c3c30449d"
server_key_iv: "18d8929601bfb00428aa03018e29e46d"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.191598 555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "3af66155e66d498bb453a969b2cab0b9"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "3c4624c2f4fcb37809ff8a4c3c30449d"
server_key_iv: "18d8929601bfb00428aa03018e29e46d"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.197849 555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:29:16.202109 574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.203898 555 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:29:16.204149 555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "3af66155e66d498bb453a969b2cab0b9"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "3c4624c2f4fcb37809ff8a4c3c30449d"
server_key_iv: "18d8929601bfb00428aa03018e29e46d"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.204401 555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:16.220615 555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:16.225716 555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:16.226040 555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:16.227172 555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:16.228765 555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:16.228856 555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.228986 555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:16.229046 555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.265492 555 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:34295
I20260806 19:29:16.265590 744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:34295 every 8 connection(s)
I20260806 19:29:16.266966 555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:29:16.268509 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 555
I20260806 19:29:16.268725 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:29:16.269443 17481 external_mini_cluster.cc:1428] Setting key 166c0ee8ded6995223d5a066161a6eb7
Aug 06 19:29:16 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:29:16.295305 751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.270866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46727 (local address 127.17.18.126:33533)
0806 19:29:16.271350 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.271355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.272796 (+ 1441us) server_negotiation.cc:407] Connection header received
0806 19:29:16.275619 (+ 2823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.275624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.275763 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.275898 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:16.278358 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.279198 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.281610 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.282565 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.282708 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.287684 (+ 4976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:16.287692 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:16.287697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:16.287751 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:16.291215 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.292225 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.292231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.292234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.292425 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.293001 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.293007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.293010 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.293482 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:16.293632 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.294602 (+ 970us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.294908 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":266,"threads_started":1}
I20260806 19:29:16.296186 752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.271301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:33533 (local address 127.17.18.66:46727)
0806 19:29:16.272573 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:16.272646 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:16.275199 (+ 2553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:16.276299 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:16.276313 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:16.277129 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:16.278082 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.278113 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.279409 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.279414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.281344 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.281367 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.282886 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.282893 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.283245 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.284162 (+ 917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:16.284195 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:16.287304 (+ 3109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:16.291445 (+ 4141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:16.291456 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:16.291473 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:16.291996 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:16.292589 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:16.292594 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:16.292596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:16.292839 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:16.293643 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:16.293651 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:16.294143 (+ 492us) client_negotiation.cc:769] Sending connection context
0806 19:29:16.294419 (+ 276us) client_negotiation.cc:240] Negotiation successful
0806 19:29:16.294932 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":393,"threads_started":1}
I20260806 19:29:16.298022 747 heartbeater.cc:347] Connected to a master server at 127.17.18.126:33533
I20260806 19:29:16.298386 747 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:16.299245 747 heartbeater.cc:511] Master 127.17.18.126:33533 requested a full tablet report, sending...
I20260806 19:29:16.301311 32727 ts_manager.cc:194] Registered new tserver with Master: 3af66155e66d498bb453a969b2cab0b9 (127.17.18.66:34295)
I20260806 19:29:16.302299 32727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:46727
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:29:16.344722 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:29:16.705166 762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:29:16.705564 762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:29:16.705711 762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:29:16.713511 762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:29:16.713656 762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:29:16.713819 762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:29:16.724160 762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:33533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:29:16.724627 545 heartbeater.cc:503] Master 127.17.18.126:33533 was elected leader, sending a full tablet report...
I20260806 19:29:16.725696 762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:29:16.727103 762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:29:16.741098 774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:16.741148 771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:29:16.741074 770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:29:16.742259 762 server_base.cc:1034] running on GCE node
I20260806 19:29:16.743016 762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:29:16.744112 762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:29:16.745322 762 hybrid_clock.cc:648] HybridClock initialized: now 1786044556745272 us; error 50 us; skew 500 ppm
I20260806 19:29:16.745708 762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:29:16 dist-test-slave-f0tn krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:29:16.748986 762 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:29:16.750679 762 webserver.cc:460] Webserver started at http://127.17.18.67:40267/ using document root <none> and password file <none>
I20260806 19:29:16.751417 762 fs_manager.cc:359] Metadata directory not provided
I20260806 19:29:16.751538 762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:29:16.751830 762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:29:16.755136 762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "2b8d969e21974bdfbd06824a5d155460"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "28c8d37c6f6b5d965fd9f50cb8ad3cdd"
server_key_iv: "3643db62143272d8490f0e0c86211870"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.755996 762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "2b8d969e21974bdfbd06824a5d155460"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "28c8d37c6f6b5d965fd9f50cb8ad3cdd"
server_key_iv: "3643db62143272d8490f0e0c86211870"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.761835 762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 19:29:16.765887 783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.767570 762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:29:16.767765 762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "2b8d969e21974bdfbd06824a5d155460"
format_stamp: "Formatted at 2026-08-06 19:29:16 on dist-test-slave-f0tn"
server_key: "28c8d37c6f6b5d965fd9f50cb8ad3cdd"
server_key_iv: "3643db62143272d8490f0e0c86211870"
server_key_version: "encryptionkey@0"
I20260806 19:29:16.768015 762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:29:16.795921 762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:29:16.800937 762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:29:16.801265 762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:29:16.802482 762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:29:16.804044 762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:29:16.804131 762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.804246 762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:29:16.804304 762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:29:16.838632 762 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:45731
I20260806 19:29:16.838716 956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:45731 every 8 connection(s)
I20260806 19:29:16.839998 762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:29:16.847919 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 762
I20260806 19:29:16.848140 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:29:16.848632 17481 external_mini_cluster.cc:1428] Setting key 02e2f956454177bc75f3df26928716f7
Aug 06 19:29:16 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:29:16.861843 960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.842763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:58235 (local address 127.17.18.126:33533)
0806 19:29:16.843267 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.843272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.844343 (+ 1071us) server_negotiation.cc:407] Connection header received
0806 19:29:16.846307 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.846313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.846399 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.846499 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:16.848411 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.849315 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.851624 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.852181 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.852291 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.856072 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:16.856077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:16.856080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:16.856116 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:16.858578 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.859450 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.859454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.859456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.859621 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.860116 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.860119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.860121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.860438 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:16.860558 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.861300 (+ 742us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.861529 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":276,"threads_started":1}
I20260806 19:29:16.863176 961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.843402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:33533 (local address 127.17.18.67:58235)
0806 19:29:16.844167 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:16.844213 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:16.846012 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:16.846772 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:16.846781 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:16.847327 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:29:16.848192 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.848224 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.849517 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.849523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.851451 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.851467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.852442 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.852448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.852676 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.853453 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:29:16.853483 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:29:16.855842 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:29:16.858761 (+ 2919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:16.858770 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:16.858787 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:16.859351 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:16.859759 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:29:16.859763 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:29:16.859766 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:29:16.860009 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:29:16.860564 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:29:16.860571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:29:16.860937 (+ 366us) client_negotiation.cc:769] Sending connection context
0806 19:29:16.861210 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 19:29:16.861710 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":296,"threads_started":1}
I20260806 19:29:16.864768 957 heartbeater.cc:347] Connected to a master server at 127.17.18.126:33533
I20260806 19:29:16.865099 957 heartbeater.cc:464] Registering TS with master...
I20260806 19:29:16.865919 957 heartbeater.cc:511] Master 127.17.18.126:33533 requested a full tablet report, sending...
I20260806 19:29:16.867535 32726 ts_manager.cc:194] Registered new tserver with Master: 2b8d969e21974bdfbd06824a5d155460 (127.17.18.67:45731)
I20260806 19:29:16.868464 32726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:58235
I20260806 19:29:16.877358 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:29:16.895076 960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.882223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55234 (local address 127.17.18.126:33533)
0806 19:29:16.882463 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.882471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.882844 (+ 373us) server_negotiation.cc:407] Connection header received
0806 19:29:16.883071 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.883076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.883160 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.883251 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:16.884744 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.885548 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.886804 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.887225 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.887344 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.889758 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:16.889763 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:16.889766 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:16.889803 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:16.892229 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.892930 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.892935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.892938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.893079 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:16.893510 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:16.893516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:16.893518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:16.893870 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:16.894121 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.894494 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.894756 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 19:29:16.899596 32726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:29:16.906808 32726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:29:16.940236 981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.919725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41495 (local address 127.0.0.1:51002)
0806 19:29:16.929451 (+ 9726us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:16.929508 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:16.929768 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:16.932438 (+ 2670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:16.932447 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:16.932489 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:29:16.933060 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.933079 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.935000 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.935006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.937186 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.937198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.939259 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.939265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.939479 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.939539 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 19:29:16.939661 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 19:29:16.939805 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9362,"mutex_wait_us":36,"thread_start_us":13047,"threads_started":1}
I20260806 19:29:16.940268 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.920451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.17.18.65:41495)
0806 19:29:16.931657 (+ 11206us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.931667 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.931703 (+ 36us) server_negotiation.cc:407] Connection header received
0806 19:29:16.931822 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.931831 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.932160 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.932407 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:29:16.933330 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.934830 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.937369 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.938990 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.939156 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.939412 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.939733 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.939922 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10996,"thread_start_us":10834,"threads_started":1}
I20260806 19:29:16.943360 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.919761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:45731 (local address 127.0.0.1:52888)
0806 19:29:16.933142 (+ 13381us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:16.933166 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:16.933288 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:16.936302 (+ 3014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:16.936307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:16.936335 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:29:16.936729 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.936741 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.938340 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.938345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.940429 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.940444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.942377 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.942384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.942596 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.942632 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:29:16.942731 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 19:29:16.942870 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13217,"mutex_wait_us":22,"thread_start_us":14080,"threads_started":1}
I20260806 19:29:16.943388 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.919847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52888 (local address 127.17.18.67:45731)
0806 19:29:16.935667 (+ 15820us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.935674 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.935707 (+ 33us) server_negotiation.cc:407] Connection header received
0806 19:29:16.935803 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.935810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.936061 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.936285 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:29:16.936921 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.938153 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.940587 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.942109 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.942310 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.942589 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.942788 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.942968 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15679,"thread_start_us":16667,"threads_started":1}
I20260806 19:29:16.944420 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.921827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.17.18.66:34295)
0806 19:29:16.933471 (+ 11644us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:16.933481 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:16.934413 (+ 932us) server_negotiation.cc:407] Connection header received
0806 19:29:16.934539 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:16.934546 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:16.934836 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:16.935051 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:29:16.935774 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.937237 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.940960 (+ 3723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.942456 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.942592 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.942776 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:16.943336 (+ 560us) server_negotiation.cc:299] Negotiation successful
0806 19:29:16.944090 (+ 754us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11439,"thread_start_us":11316,"threads_started":1}
I20260806 19:29:16.945165 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:16.921520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:34295 (local address 127.0.0.1:41410)
0806 19:29:16.934130 (+ 12610us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:16.934147 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:16.934280 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:16.935034 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:16.935039 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:16.935071 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:29:16.935561 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.935575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.937370 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.937394 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.940766 (+ 3372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:16.940782 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:16.942928 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:16.942934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:16.943113 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:16.943147 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:29:16.944764 (+ 1617us) client_negotiation.cc:240] Negotiation successful
0806 19:29:16.944886 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12454,"mutex_wait_us":4,"thread_start_us":7382,"threads_started":1}
I20260806 19:29:16.945180 444 tablet_service.cc:1467] Processing CreateTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 (DEFAULT_TABLE table=test-table [id=bb922f16c5d449fca6d23af2b2a7f585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:29:16.946965 444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4242c92c19a84cbfa0af192f39bcf198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:29:16.947760 859 tablet_service.cc:1467] Processing CreateTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 (DEFAULT_TABLE table=test-table [id=bb922f16c5d449fca6d23af2b2a7f585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:29:16.948381 649 tablet_service.cc:1467] Processing CreateTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 (DEFAULT_TABLE table=test-table [id=bb922f16c5d449fca6d23af2b2a7f585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:29:16.949400 859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4242c92c19a84cbfa0af192f39bcf198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:29:16.949571 649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4242c92c19a84cbfa0af192f39bcf198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:29:16.961501 983 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Bootstrap starting.
I20260806 19:29:16.964821 985 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Bootstrap starting.
I20260806 19:29:16.965281 983 tablet_bootstrap.cc:654] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:16.966809 983 log.cc:824] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:16.968434 984 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Bootstrap starting.
I20260806 19:29:16.968799 985 tablet_bootstrap.cc:654] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:16.970618 985 log.cc:824] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:16.971904 984 tablet_bootstrap.cc:654] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Neither blocks nor log segments found. Creating new log.
I20260806 19:29:16.972999 984 log.cc:824] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Log is configured to *not* fsync() on all Append() calls
I20260806 19:29:16.973424 983 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: No bootstrap required, opened a new log
I20260806 19:29:16.973757 983 ts_tablet_manager.cc:1397] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260806 19:29:16.975082 985 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: No bootstrap required, opened a new log
I20260806 19:29:16.975386 985 ts_tablet_manager.cc:1397] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260806 19:29:16.976233 984 tablet_bootstrap.cc:492] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: No bootstrap required, opened a new log
I20260806 19:29:16.976502 984 ts_tablet_manager.cc:1397] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 19:29:16.982103 983 raft_consensus.cc:348] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.982532 983 raft_consensus.cc:374] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:16.982636 983 raft_consensus.cc:729] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3af66155e66d498bb453a969b2cab0b9, State: Initialized, Role: FOLLOWER
I20260806 19:29:16.983279 983 consensus_queue.cc:260] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.984447 747 heartbeater.cc:503] Master 127.17.18.126:33533 was elected leader, sending a full tablet report...
I20260806 19:29:16.986660 983 ts_tablet_manager.cc:1428] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260806 19:29:16.987334 984 raft_consensus.cc:348] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.987372 985 raft_consensus.cc:348] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.987879 985 raft_consensus.cc:374] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:16.987879 984 raft_consensus.cc:374] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:29:16.987988 984 raft_consensus.cc:729] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42ba4e9a0cff4e54982e7b8c274c3a51, State: Initialized, Role: FOLLOWER
I20260806 19:29:16.987988 985 raft_consensus.cc:729] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8d969e21974bdfbd06824a5d155460, State: Initialized, Role: FOLLOWER
I20260806 19:29:16.988715 985 consensus_queue.cc:260] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.988716 984 consensus_queue.cc:260] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:16.990176 957 heartbeater.cc:503] Master 127.17.18.126:33533 was elected leader, sending a full tablet report...
I20260806 19:29:16.991006 985 ts_tablet_manager.cc:1428] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260806 19:29:16.991039 984 ts_tablet_manager.cc:1428] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
W20260806 19:29:17.019454 748 tablet.cc:2369] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:29:17.091773 959 tablet.cc:2369] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:29:17.103190 991 raft_consensus.cc:482] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:29:17.103538 991 raft_consensus.cc:504] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:17.105464 991 leader_election.cc:288] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b8d969e21974bdfbd06824a5d155460 (127.17.18.67:45731), 42ba4e9a0cff4e54982e7b8c274c3a51 (127.17.18.65:41495)
I20260806 19:29:17.113713 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.105976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:37997 (local address 127.17.18.65:41495)
0806 19:29:17.106198 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.106203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.107004 (+ 801us) server_negotiation.cc:407] Connection header received
0806 19:29:17.107199 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.107204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.107294 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.107412 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:29:17.108382 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.109597 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.111788 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.112595 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.112776 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.112860 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.113253 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.113444 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:29:17.113709 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.106057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35603 (local address 127.17.18.67:45731)
0806 19:29:17.106256 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.106262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.107003 (+ 741us) server_negotiation.cc:407] Connection header received
0806 19:29:17.107249 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.107254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.107330 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.107418 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:29:17.108381 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.109601 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.111761 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.112578 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.112761 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.112850 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.113252 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.113432 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 19:29:17.114218 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.105809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41495 (local address 127.17.18.66:37997)
0806 19:29:17.106846 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:17.106874 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:17.107050 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:17.107491 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:17.107497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:17.107550 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:29:17.108155 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:17.108166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.109826 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.109831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:17.111586 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:17.111602 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.112897 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.112905 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:17.113070 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.113094 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 19:29:17.113201 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 19:29:17.113445 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"mutex_wait_us":132,"spinlock_wait_cycles":17536,"thread_start_us":610,"threads_started":1}
I20260806 19:29:17.114284 994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.105893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:45731 (local address 127.17.18.66:35603)
0806 19:29:17.106867 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0806 19:29:17.106881 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 19:29:17.107090 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:29:17.107491 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:29:17.107497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:29:17.107552 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:29:17.108097 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:17.108121 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.109862 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.109868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:17.111559 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:29:17.111579 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.112861 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.112868 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:29:17.113060 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.113088 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 19:29:17.113201 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 19:29:17.113458 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":101,"spinlock_wait_cycles":57472,"thread_start_us":492,"threads_started":1}
I20260806 19:29:17.115410 884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4242c92c19a84cbfa0af192f39bcf198" candidate_uuid: "3af66155e66d498bb453a969b2cab0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d969e21974bdfbd06824a5d155460" is_pre_election: true
I20260806 19:29:17.115410 472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4242c92c19a84cbfa0af192f39bcf198" candidate_uuid: "3af66155e66d498bb453a969b2cab0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" is_pre_election: true
I20260806 19:29:17.115938 884 raft_consensus.cc:2454] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af66155e66d498bb453a969b2cab0b9 in term 0.
I20260806 19:29:17.115938 472 raft_consensus.cc:2454] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3af66155e66d498bb453a969b2cab0b9 in term 0.
I20260806 19:29:17.116784 579 leader_election.cc:302] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2b8d969e21974bdfbd06824a5d155460, 3af66155e66d498bb453a969b2cab0b9, 42ba4e9a0cff4e54982e7b8c274c3a51; no voters:
I20260806 19:29:17.117303 991 raft_consensus.cc:2781] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:29:17.117491 991 raft_consensus.cc:482] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:29:17.117601 991 raft_consensus.cc:3037] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:17.120070 991 raft_consensus.cc:504] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:17.120822 991 leader_election.cc:288] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [CANDIDATE]: Term 1 election: Requested vote from peers 2b8d969e21974bdfbd06824a5d155460 (127.17.18.67:45731), 42ba4e9a0cff4e54982e7b8c274c3a51 (127.17.18.65:41495)
I20260806 19:29:17.121337 884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4242c92c19a84cbfa0af192f39bcf198" candidate_uuid: "3af66155e66d498bb453a969b2cab0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b8d969e21974bdfbd06824a5d155460"
I20260806 19:29:17.121483 472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4242c92c19a84cbfa0af192f39bcf198" candidate_uuid: "3af66155e66d498bb453a969b2cab0b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51"
I20260806 19:29:17.121639 884 raft_consensus.cc:3037] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:17.121747 472 raft_consensus.cc:3037] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:29:17.124097 884 raft_consensus.cc:2454] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af66155e66d498bb453a969b2cab0b9 in term 1.
I20260806 19:29:17.124248 472 raft_consensus.cc:2454] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3af66155e66d498bb453a969b2cab0b9 in term 1.
I20260806 19:29:17.124631 577 leader_election.cc:302] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b8d969e21974bdfbd06824a5d155460, 3af66155e66d498bb453a969b2cab0b9; no voters:
I20260806 19:29:17.125015 991 raft_consensus.cc:2781] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:29:17.125551 991 raft_consensus.cc:686] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 1 LEADER]: Becoming Leader. State: Replica: 3af66155e66d498bb453a969b2cab0b9, State: Running, Role: LEADER
I20260806 19:29:17.126148 991 consensus_queue.cc:237] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } }
I20260806 19:29:17.131174 32726 catalog_manager.cc:5495] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3af66155e66d498bb453a969b2cab0b9 (127.17.18.66). New cstate: current_term: 1 leader_uuid: "3af66155e66d498bb453a969b2cab0b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3af66155e66d498bb453a969b2cab0b9" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 34295 } health_report { overall_health: HEALTHY } } }
I20260806 19:29:17.182227 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.176185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41424 (local address 127.17.18.66:34295)
0806 19:29:17.176391 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.176396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.176447 (+ 51us) server_negotiation.cc:407] Connection header received
0806 19:29:17.176665 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.176669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.176774 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.176928 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:29:17.177449 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.178303 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.179950 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.180402 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.180510 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.181068 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:29:17.181652 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:29:17.181792 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.181906 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.181990 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 19:29:17.190508 546 tablet.cc:2369] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:29:17.191584 472 raft_consensus.cc:1261] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 1 FOLLOWER]: Refusing update from remote peer 3af66155e66d498bb453a969b2cab0b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:29:17.191572 884 raft_consensus.cc:1261] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 1 FOLLOWER]: Refusing update from remote peer 3af66155e66d498bb453a969b2cab0b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:29:17.192631 997 consensus_queue.cc:1035] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b8d969e21974bdfbd06824a5d155460" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:29:17.192998 991 consensus_queue.cc:1035] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42ba4e9a0cff4e54982e7b8c274c3a51" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:29:17.205693 1001 mvcc.cc:205] Tried to move back new op lower bound from 7315638506245074944 to 7315638505992863744. Current Snapshot: MvccSnapshot[applied={T|T < 7315638506245074944}]
I20260806 19:29:17.220111 32726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:29:17.220412 32726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:29:17.224550 32726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e791c24b236b4024b5dfcb34ca6d9fce: Sending DeleteTablet for 3 replicas of tablet 4242c92c19a84cbfa0af192f39bcf198
I20260806 19:29:17.226052 859 tablet_service.cc:1514] Processing DeleteTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:29:17 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:52888
I20260806 19:29:17.226364 649 tablet_service.cc:1514] Processing DeleteTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:29:17 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:41410
I20260806 19:29:17.226404 444 tablet_service.cc:1514] Processing DeleteTablet for tablet 4242c92c19a84cbfa0af192f39bcf198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:29:17 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:51002
I20260806 19:29:17.228472 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 347
I20260806 19:29:17.238799 1019 tablet_replica.cc:330] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: stopping tablet replica
I20260806 19:29:17.239487 1015 tablet_replica.cc:330] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: stopping tablet replica
I20260806 19:29:17.240154 1021 tablet_replica.cc:330] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: stopping tablet replica
I20260806 19:29:17.240528 1019 raft_consensus.cc:2229] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:29:17.241110 1021 raft_consensus.cc:2229] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:29:17.241155 1019 raft_consensus.cc:2258] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:29:17.241365 1015 raft_consensus.cc:2229] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:29:17.242516 1015 raft_consensus.cc:2258] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:29:17.243268 1021 raft_consensus.cc:2258] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:29:17.243698 1019 ts_tablet_manager.cc:1905] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:29:17.245791 1015 ts_tablet_manager.cc:1905] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:29:17.248478 1021 ts_tablet_manager.cc:1905] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:29:17.251817 1019 ts_tablet_manager.cc:1918] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:29:17.252030 1019 log.cc:1196] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/4242c92c19a84cbfa0af192f39bcf198
I20260806 19:29:17.252671 1019 ts_tablet_manager.cc:1939] T 4242c92c19a84cbfa0af192f39bcf198 P 42ba4e9a0cff4e54982e7b8c274c3a51: Deleting consensus metadata
I20260806 19:29:17.255487 32708 catalog_manager.cc:4841] TS 42ba4e9a0cff4e54982e7b8c274c3a51 (127.17.18.65:41495): tablet 4242c92c19a84cbfa0af192f39bcf198 (table test-table [id=bb922f16c5d449fca6d23af2b2a7f585]) successfully deleted
I20260806 19:29:17.259086 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.230649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.17.18.65:41495)
0806 19:29:17.230877 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.230885 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.234026 (+ 3141us) server_negotiation.cc:407] Connection header received
0806 19:29:17.234257 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.234264 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.234374 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.234519 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:17.239856 (+ 5337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.241026 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.243656 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.244271 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.244385 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.250394 (+ 6009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:17.250414 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:17.250436 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:17.250490 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:17.255855 (+ 5365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.256751 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.256759 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.256762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.256922 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.257362 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.257366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.257368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.257817 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:17.258144 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.258470 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.258709 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:29:17.259864 532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:17.266098 1015 ts_tablet_manager.cc:1918] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:29:17.266325 1015 log.cc:1196] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/4242c92c19a84cbfa0af192f39bcf198
I20260806 19:29:17.266942 1015 ts_tablet_manager.cc:1939] T 4242c92c19a84cbfa0af192f39bcf198 P 2b8d969e21974bdfbd06824a5d155460: Deleting consensus metadata
I20260806 19:29:17.269276 32706 catalog_manager.cc:4841] TS 2b8d969e21974bdfbd06824a5d155460 (127.17.18.67:45731): tablet 4242c92c19a84cbfa0af192f39bcf198 (table test-table [id=bb922f16c5d449fca6d23af2b2a7f585]) successfully deleted
I20260806 19:29:17.272014 1021 ts_tablet_manager.cc:1918] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:29:17.272331 1021 log.cc:1196] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/4242c92c19a84cbfa0af192f39bcf198
I20260806 19:29:17.272969 1021 ts_tablet_manager.cc:1939] T 4242c92c19a84cbfa0af192f39bcf198 P 3af66155e66d498bb453a969b2cab0b9: Deleting consensus metadata
I20260806 19:29:17.275390 32705 catalog_manager.cc:4841] TS 3af66155e66d498bb453a969b2cab0b9 (127.17.18.66:34295): tablet 4242c92c19a84cbfa0af192f39bcf198 (table test-table [id=bb922f16c5d449fca6d23af2b2a7f585]) successfully deleted
I20260806 19:29:17.368254 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 347
I20260806 19:29:17.395567 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 555
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:29:17.412292 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.396518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41426 (local address 127.17.18.66:34295)
0806 19:29:17.396728 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.396735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.396756 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:29:17.396832 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.396837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.396920 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.397018 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:17.398362 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.399205 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.400487 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.400983 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.401115 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.405667 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:17.405692 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:17.405713 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:17.405769 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:17.409008 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.409959 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.409970 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.409974 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.410160 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.410564 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.410572 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.410574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.410995 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:17.411336 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.411664 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.411907 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:29:17.413086 737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:17.531648 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 555
I20260806 19:29:17.561127 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 762
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[32663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:29:17.577497 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:29:17.562022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52896 (local address 127.17.18.67:45731)
0806 19:29:17.562209 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 19:29:17.562214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:29:17.562233 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:29:17.562350 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:29:17.562354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:29:17.562429 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:29:17.562512 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:29:17.563880 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.564626 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.566167 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:29:17.566584 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:29:17.566695 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:29:17.571324 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:29:17.571343 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:29:17.571362 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:29:17.571402 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:29:17.574479 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.575274 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.575284 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.575286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.575446 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:29:17.575835 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:29:17.575839 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:29:17.575841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:29:17.576245 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:29:17.576548 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 19:29:17.576862 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 19:29:17.577094 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 19:29:17.578186 948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:17.670748 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 762
I20260806 19:29:17.693531 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 32680
I20260806 19:29:17.694801 306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:29:17.809612 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 32680
2026-08-06T19:29:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4857 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[1035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[1035](info): set up 2 sockets
Aug 06 19:29:17 dist-test-slave-f0tn krb5kdc[1035](info): commencing operation
krb5kdc: starting...
W20260806 19:29:19.063591 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:29:19 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:29:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:29:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangeradmin_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangeradmin_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangerlookup_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangerlookup_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
I20260806 19:29:19.513761 17481 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/postgres -l logfile start
2026-08-06 19:29:22.569 UTC [1081] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 19:29:22.569 UTC [1081] LOG: listening on IPv4 address "127.17.18.84", port 40797
2026-08-06 19:29:22.573 UTC [1081] LOG: listening on Unix socket "/tmp/.s.PGSQL.40797"
2026-08-06 19:29:22.596 UTC [1086] LOG: database system was shut down at 2026-08-06 19:29:20 UTC
2026-08-06 19:29:22.600 UTC [1081] LOG: database system is ready to accept connections
I20260806 19:29:23.685884 17481 mini_postgres.cc:96] Postgres bound to 40797
2026-08-06 19:29:23.711 UTC [1101] FATAL: database "slave" does not exist
127.17.18.84:40797 - accepting connections
I20260806 19:29:23.712653 17481 mini_ranger.cc:161] Starting Ranger...
I20260806 19:29:23.748687 17481 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 19:29:24.330817 17481 mini_ranger.cc:87] Created ranger Postgres database
I20260806 19:29:24.331007 17481 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin
2026-08-06 19:29:24,654 [I] DB FLAVOR :POSTGRES
2026-08-06 19:29:24,655 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 19:29:24,655 [I] Checking connection..
2026-08-06 19:29:24,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 19:29:24,931 [I] Checking connection passed.
2026-08-06 19:29:24,931 [I] --------- Verifying version history table ---------
2026-08-06 19:29:24,932 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:29:25,221 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 19:29:25,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:29:25,511 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 19:29:25,511 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 19:29:25,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 19:29:25.778 UTC [1194] WARNING: there is no transaction in progress
2026-08-06 19:29:25,788 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 19:29:25,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:29:26,068 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 19:29:26,068 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 19:29:26,069 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 19:29:26,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 19:29:26,600 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-f0tn.c.gcp-upstream.internal','N') ;"
2026-08-06 19:29:26,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 19:29:27,153 [I] Table x_portal_user does not exist in database ranger
2026-08-06 19:29:27,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 19:29:27,415 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 19:29:27,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 19:29:27,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 19:29:27,927 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 19:29:27,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 19:29:29.059 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.080 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.103 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.122 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.142 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.164 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.231 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.240 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.257 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.269 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.281 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.297 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.309 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.317 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.326 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:29.334 UTC [1369] WARNING: there is no transaction in progress
2026-08-06 19:29:30,126 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 19:29:30,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 19:29:30,410 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 19:29:30,410 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 19:29:30,666 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 19:29:30,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 19:29:30,940 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 19:29:30,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 19:29:31,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 19:29:31,490 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-f0tn.c.gcp-upstream.internal';"
2026-08-06 19:29:31,743 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 19:29:31,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 19:29:32,037 [I] DB_PATCHES have already been applied
I20260806 19:29:32.044520 17481 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 19:29:32.044658 17481 mini_ranger.cc:193] Using host: 127.17.18.84
I20260806 19:29:32.070007 17481 mini_ranger.cc:227] Ranger admin URL: http://127.17.18.84:35713
Aug 06, 2026 7:29:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 7:29:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 7:29:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 7:29:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 7:29:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 7:29:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 7:29:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 19:29:33.330571 17481 mini_ranger.cc:160] Time spent starting Ranger: real 9.618s user 0.004s sys 0.077s
Aug 06, 2026 7:29:55 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 7:29:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 06, 2026 7:29:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 7:29:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 7:29:56 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 19:29:57.625629 17481 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangerkms_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/rangerkms_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.18.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.18.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 19:29:57 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044597, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 19:29:57.866524 17481 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 19:29:57.898730 17481 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 19:29:59.073699 17481 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 19:29:59.073851 17481 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms
I20260806 19:29:59.074015 17481 mini_ranger_kms.cc:227] Using postgres at 127.17.18.84:40797
2026-08-06 19:29:59,591 [I] DB FLAVOR :POSTGRES
2026-08-06 19:29:59,592 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 19:29:59,592 [I] Checking connection
2026-08-06 19:29:59,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 19:29:59,862 [I] connection success
2026-08-06 19:29:59,863 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 19:29:59,863 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 19:29:59,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 19:30:00,113 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 19:30:00,113 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 19:30:00,113 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 19:30:00,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:40797/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 19:30:00,394 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 19:30:00.982862 17481 mini_ranger_kms.cc:310] Created kms service
I20260806 19:30:01.235329 17481 mini_ranger_kms.cc:326] Created kudu user
I20260806 19:30:01.289837 17481 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 19:30:01 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044597, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:01.721103 17481 mini_ranger_kms.cc:384] Added ranger policy
I20260806 19:30:01.722702 17481 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 19:30:01.722774 17481 mini_ranger_kms.cc:240] Using host: 127.17.18.84
I20260806 19:30:01.751055 17481 mini_ranger_kms.cc:276] Ranger KMS PID: 1641
I20260806 19:30:01.751273 17481 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.18.84:58935
Aug 06, 2026 7:30:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 7:30:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 7:30:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 7:30:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 7:30:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 7:30:03 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 19:30:04 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786044604, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:30:04.270440 17481 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.404s user 0.129s sys 0.426s
I20260806 19:30:04.270818 17481 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 19:30:04.271066 17481 mini_ranger_kms.cc:401] 127.17.18.84:58935/kms/v1/keys
Aug 06 19:30:04 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044604, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
Aug 06 19:30:04 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044604, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
Aug 06 19:30:07 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:30:07.582741 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36309
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:36309
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:58935/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:30:08.271486 1715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:30:08.272006 1715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:30:08.272275 1715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:30:08.285311 1715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:30:08.285629 1715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:30:08.285810 1715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:30:08.286042 1715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:30:08.286203 1715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:30:08.302649 1715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.18.84:58935/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:36309
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:30:08.304409 1715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:30:08.306345 1715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:30:08.331563 1721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:08.331615 1722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:08.332815 1724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:30:08.335726 1715 server_base.cc:1034] running on GCE node
I20260806 19:30:08.336835 1715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:30:08.338986 1715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:30:08.340277 1715 hybrid_clock.cc:648] HybridClock initialized: now 1786044608340211 us; error 46 us; skew 500 ppm
I20260806 19:30:08.340763 1715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:30:08 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044608, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:30:08.352981 1715 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:30:08.356600 1715 webserver.cc:460] Webserver started at http://127.17.18.126:35617/ using document root <none> and password file <none>
I20260806 19:30:08.357736 1715 fs_manager.cc:359] Metadata directory not provided
I20260806 19:30:08.358003 1715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:30:08.358428 1715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:30:08 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044608, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:08.438377 1715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "3e8481ca9d854144bce32a2b4eb06864"
format_stamp: "Formatted at 2026-08-06 19:30:08 on dist-test-slave-f0tn"
server_key: "7f1edc92ea76cf1168eb4773a445fb41"
server_key_iv: "9cb76a9600548dfbd98d0b5fafab18bf"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:08.439517 1715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "3e8481ca9d854144bce32a2b4eb06864"
format_stamp: "Formatted at 2026-08-06 19:30:08 on dist-test-slave-f0tn"
server_key: "7f1edc92ea76cf1168eb4773a445fb41"
server_key_iv: "9cb76a9600548dfbd98d0b5fafab18bf"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:08.448019 1715 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.002s
I20260806 19:30:08.475039 1733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:08.476977 1715 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.004s
I20260806 19:30:08.477250 1715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "3e8481ca9d854144bce32a2b4eb06864"
format_stamp: "Formatted at 2026-08-06 19:30:08 on dist-test-slave-f0tn"
server_key: "7f1edc92ea76cf1168eb4773a445fb41"
server_key_iv: "9cb76a9600548dfbd98d0b5fafab18bf"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:08.477671 1715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:30:08.497825 1715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:30:08.504807 1715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:30:08.505460 1715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:30:08.577613 1715 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:36309
I20260806 19:30:08.577777 1816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:36309 every 8 connection(s)
I20260806 19:30:08.579891 1715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:30:08.581103 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 1715
I20260806 19:30:08.581358 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:30:08.582435 17481 external_mini_cluster.cc:1428] Setting key 5534f6b8c05ce53b42c16d598e6fd16b
I20260806 19:30:08.596398 1818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:30:08 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:30:08.626976 1818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: Bootstrap starting.
I20260806 19:30:08.632067 1822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:08.586149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46610 (local address 127.17.18.126:36309)
0806 19:30:08.603002 (+ 16853us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:08.603046 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:08.603159 (+ 113us) server_negotiation.cc:407] Connection header received
0806 19:30:08.607942 (+ 4783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:08.607985 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:08.608621 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:08.609139 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:08.610799 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:08.613126 (+ 2327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:08.614646 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:08.615768 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:08.615964 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:08.620526 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:08.620541 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:08.620567 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:08.620617 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:08.626338 (+ 5721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:08.627254 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:08.627266 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:08.627275 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:08.627611 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:08.628114 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:08.628117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:08.628119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:08.628920 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:08.629503 (+ 583us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:08.629937 (+ 434us) server_negotiation.cc:299] Negotiation successful
0806 19:30:08.630407 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16447,"thread_start_us":15812,"threads_started":1}
I20260806 19:30:08.637420 1818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: Neither blocks nor log segments found. Creating new log.
I20260806 19:30:08.640182 1818 log.cc:824] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: Log is configured to *not* fsync() on all Append() calls
I20260806 19:30:08.647904 1818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: No bootstrap required, opened a new log
I20260806 19:30:08.663647 1818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } }
I20260806 19:30:08.664534 1818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:30:08.664773 1818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8481ca9d854144bce32a2b4eb06864, State: Initialized, Role: FOLLOWER
I20260806 19:30:08.665870 1818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } }
I20260806 19:30:08.666353 1818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:30:08.666646 1818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:30:08.666937 1818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:30:08.671247 1818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } }
I20260806 19:30:08.672061 1818 leader_election.cc:302] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8481ca9d854144bce32a2b4eb06864; no voters:
I20260806 19:30:08.673682 1818 leader_election.cc:288] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:30:08.673931 1825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:30:08.677189 1825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8481ca9d854144bce32a2b4eb06864, State: Running, Role: LEADER
I20260806 19:30:08.678242 1825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } }
I20260806 19:30:08.678750 1818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:30:08.686362 1827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e8481ca9d854144bce32a2b4eb06864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } } }
I20260806 19:30:08.686618 1828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e8481ca9d854144bce32a2b4eb06864. Latest consensus state: current_term: 1 leader_uuid: "3e8481ca9d854144bce32a2b4eb06864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8481ca9d854144bce32a2b4eb06864" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36309 } } }
I20260806 19:30:08.687544 1827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [sys.catalog]: This master's current role is: LEADER
I20260806 19:30:08.687593 1828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864 [sys.catalog]: This master's current role is: LEADER
I20260806 19:30:08.700067 1833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:30:08.722736 1833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:30:08.723795 1818 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 19:30:08.766834 1833 catalog_manager.cc:1347] Generated new cluster ID: 9099041362914e02a84f36fee6004a80
I20260806 19:30:08.767091 1833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:30:08.789368 1833 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:30:08.792248 1833 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:30:08.803954 1833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: Generated new TSK 0
I20260806 19:30:08.805503 1833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:30:09.765672 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:58935/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:30:10 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 19:30:10.610544 1874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:30:10.611135 1874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:30:10.611582 1874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:30:10.629338 1874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:30:10.629752 1874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:30:10.630059 1874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:30:10.651810 1874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.18.84:58935/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:30:10.653995 1874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:30:10.656235 1874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:30:10.693677 1887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:10.696342 1888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:30:10.697062 1874 server_base.cc:1034] running on GCE node
W20260806 19:30:10.702754 1890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:30:10.704187 1874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:30:10.714457 1874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:30:10.715888 1874 hybrid_clock.cc:648] HybridClock initialized: now 1786044610715750 us; error 93 us; skew 500 ppm
I20260806 19:30:10.716698 1874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:30:10 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:30:10.725664 1874 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:30:10.736392 1874 webserver.cc:460] Webserver started at http://127.17.18.65:40827/ using document root <none> and password file <none>
I20260806 19:30:10.737658 1874 fs_manager.cc:359] Metadata directory not provided
I20260806 19:30:10.737859 1874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:30:10.738317 1874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:30:10 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:10.762926 1874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "3a08e53440494178821d476a081e392e"
format_stamp: "Formatted at 2026-08-06 19:30:10 on dist-test-slave-f0tn"
server_key: "2dd02dc2e5eb724a7699935202c5de7d"
server_key_iv: "4087fb1b345180d37292cfac53572b91"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:10.764339 1874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "3a08e53440494178821d476a081e392e"
format_stamp: "Formatted at 2026-08-06 19:30:10 on dist-test-slave-f0tn"
server_key: "2dd02dc2e5eb724a7699935202c5de7d"
server_key_iv: "4087fb1b345180d37292cfac53572b91"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:10.775439 1874 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.009s sys 0.001s
I20260806 19:30:10.802908 1901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:10.805023 1874 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.004s
I20260806 19:30:10.805503 1874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "3a08e53440494178821d476a081e392e"
format_stamp: "Formatted at 2026-08-06 19:30:10 on dist-test-slave-f0tn"
server_key: "2dd02dc2e5eb724a7699935202c5de7d"
server_key_iv: "4087fb1b345180d37292cfac53572b91"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:10.806140 1874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:30:10.842936 1874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:30:10.852309 1874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:30:10.853318 1874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:30:10.872222 1874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:30:10.883236 1874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:30:10.883738 1874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.001s
I20260806 19:30:10.884265 1874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:30:10.884644 1874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 19:30:10 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:11.176693 1874 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:46083
I20260806 19:30:11.176963 2051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:46083 every 8 connection(s)
I20260806 19:30:11.178784 1874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:30:11.188483 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 1874
I20260806 19:30:11.188946 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:30:11.190259 17481 external_mini_cluster.cc:1428] Setting key 07fa07e8cfc158605cb3b97828eff457
Aug 06 19:30:11 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
I20260806 19:30:11.243350 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:11.185363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36309 (local address 127.17.18.65:38827)
0806 19:30:11.196531 (+ 11168us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:11.196601 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:11.208082 (+ 11481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:11.209950 (+ 1868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:11.209966 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:11.211026 (+ 1060us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:30:11.212249 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:11.212291 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:11.214244 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:11.214251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:11.217967 (+ 3716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:11.217998 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:11.220527 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:11.220543 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:11.221214 (+ 671us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:11.222515 (+ 1301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:30:11.222580 (+ 65us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:30:11.227607 (+ 5027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:30:11.235994 (+ 8387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:11.236007 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:11.236045 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:11.237029 (+ 984us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:11.237906 (+ 877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:11.237913 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:11.237916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:11.238432 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:11.239468 (+ 1036us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:30:11.239478 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:30:11.240093 (+ 615us) client_negotiation.cc:769] Sending connection context
0806 19:30:11.240472 (+ 379us) client_negotiation.cc:240] Negotiation successful
0806 19:30:11.241220 (+ 748us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10521,"thread_start_us":11628,"threads_started":1}
I20260806 19:30:11.244979 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:11.184128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:38827 (local address 127.17.18.126:36309)
0806 19:30:11.190212 (+ 6084us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:11.190220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:11.196889 (+ 6669us) server_negotiation.cc:407] Connection header received
0806 19:30:11.208598 (+ 11709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:11.208605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:11.208729 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:11.208872 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:11.212587 (+ 3715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:11.213896 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:11.218305 (+ 4409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:11.219598 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:11.219751 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:11.228207 (+ 8456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:11.228223 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:11.228230 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:11.228291 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:11.235705 (+ 7414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:11.237308 (+ 1603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:11.237316 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:11.237320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:11.237715 (+ 395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:11.238610 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:11.238616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:11.238620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:11.239201 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:11.239357 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:11.244116 (+ 4759us) server_negotiation.cc:299] Negotiation successful
0806 19:30:11.244447 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5920,"thread_start_us":5599,"threads_started":1}
I20260806 19:30:11.247437 2052 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36309
I20260806 19:30:11.247974 2052 heartbeater.cc:464] Registering TS with master...
I20260806 19:30:11.249573 2052 heartbeater.cc:511] Master 127.17.18.126:36309 requested a full tablet report, sending...
I20260806 19:30:11.253415 1761 ts_manager.cc:194] Registered new tserver with Master: 3a08e53440494178821d476a081e392e (127.17.18.65:46083)
I20260806 19:30:11.256402 1761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:38827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:30:11.285171 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:58935/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:30:11 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044610, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
W20260806 19:30:12.214771 2063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:30:12.215255 2063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:30:12.215544 2063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:30:12.228586 2063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:30:12.228858 2063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:30:12.229139 2063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:30:12.246670 2063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.18.84:58935/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:30:12.248478 2063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:30:12.250388 2063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 19:30:12.262010 2052 heartbeater.cc:503] Master 127.17.18.126:36309 was elected leader, sending a full tablet report...
W20260806 19:30:12.278863 2087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:12.279156 2085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:12.279785 2084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:30:12.289944 2063 server_base.cc:1034] running on GCE node
I20260806 19:30:12.290987 2063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:30:12.292819 2063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:30:12.294363 2063 hybrid_clock.cc:648] HybridClock initialized: now 1786044612294122 us; error 60 us; skew 500 ppm
I20260806 19:30:12.295226 2063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:30:12 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044612, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:30:12.302758 2063 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:30:12.305907 2063 webserver.cc:460] Webserver started at http://127.17.18.66:37227/ using document root <none> and password file <none>
I20260806 19:30:12.307353 2063 fs_manager.cc:359] Metadata directory not provided
I20260806 19:30:12.307672 2063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:30:12.308455 2063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:30:12 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044612, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:12.332795 2063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "eccb09e0b51f49af8985224a74df184d"
format_stamp: "Formatted at 2026-08-06 19:30:12 on dist-test-slave-f0tn"
server_key: "0d0ef75369fb39574997ef034c54a1ed"
server_key_iv: "860a1b8deabcf81cf68460c420ec0a8a"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:12.335438 2063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "eccb09e0b51f49af8985224a74df184d"
format_stamp: "Formatted at 2026-08-06 19:30:12 on dist-test-slave-f0tn"
server_key: "0d0ef75369fb39574997ef034c54a1ed"
server_key_iv: "860a1b8deabcf81cf68460c420ec0a8a"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:12.347115 2063 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.005s sys 0.005s
I20260806 19:30:12.372943 2098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:12.375468 2063 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:30:12.375835 2063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "eccb09e0b51f49af8985224a74df184d"
format_stamp: "Formatted at 2026-08-06 19:30:12 on dist-test-slave-f0tn"
server_key: "0d0ef75369fb39574997ef034c54a1ed"
server_key_iv: "860a1b8deabcf81cf68460c420ec0a8a"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:12.376304 2063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:30:12.409512 2063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:30:12.416729 2063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:30:12.417418 2063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:30:12.419775 2063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:30:12.423024 2063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:30:12.423251 2063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:12.423614 2063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:30:12.423796 2063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:12.582175 2063 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:46019
I20260806 19:30:12.582413 2264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:46019 every 8 connection(s)
I20260806 19:30:12.584368 2063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:30:12.588847 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 2063
I20260806 19:30:12.589123 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:30:12.589735 17481 external_mini_cluster.cc:1428] Setting key 2724dd7943d1137d63bdc529667e8bc7
Aug 06 19:30:12 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044612, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
I20260806 19:30:12.633354 2269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:12.591554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46685 (local address 127.17.18.126:36309)
0806 19:30:12.598304 (+ 6750us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:12.598311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:12.598340 (+ 29us) server_negotiation.cc:407] Connection header received
0806 19:30:12.601804 (+ 3464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:12.601812 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:12.601920 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:12.602055 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:12.605540 (+ 3485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:12.607441 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:12.611566 (+ 4125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:12.612733 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:12.612901 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:12.620704 (+ 7803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:12.620712 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:12.620717 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:12.620769 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:12.627484 (+ 6715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:12.629126 (+ 1642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:12.629133 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:12.629137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:12.629495 (+ 358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:12.630378 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:12.630384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:12.630387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:12.630974 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:12.631129 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:12.632420 (+ 1291us) server_negotiation.cc:299] Negotiation successful
0806 19:30:12.632682 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6578,"thread_start_us":6233,"threads_started":1}
I20260806 19:30:12.635035 2268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:12.590554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36309 (local address 127.17.18.66:46685)
0806 19:30:12.595918 (+ 5364us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:12.595996 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:12.601286 (+ 5290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:12.602513 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:12.602529 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:12.603664 (+ 1135us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:30:12.605239 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:12.605276 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:12.607778 (+ 2502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:12.607786 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:12.611218 (+ 3432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:12.611321 (+ 103us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:12.613313 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:12.613327 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:12.613993 (+ 666us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:12.615366 (+ 1373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:30:12.615412 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:30:12.620239 (+ 4827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:30:12.627826 (+ 7587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:12.627842 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:12.627868 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:12.628903 (+ 1035us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:12.629656 (+ 753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:12.629662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:12.629666 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:12.630190 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:12.631147 (+ 957us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:30:12.631157 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:30:12.631778 (+ 621us) client_negotiation.cc:769] Sending connection context
0806 19:30:12.632146 (+ 368us) client_negotiation.cc:240] Negotiation successful
0806 19:30:12.632918 (+ 772us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4904,"thread_start_us":4327,"threads_started":1}
I20260806 19:30:12.637583 2265 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36309
I20260806 19:30:12.638162 2265 heartbeater.cc:464] Registering TS with master...
I20260806 19:30:12.639654 2265 heartbeater.cc:511] Master 127.17.18.126:36309 requested a full tablet report, sending...
I20260806 19:30:12.642345 1761 ts_manager.cc:194] Registered new tserver with Master: eccb09e0b51f49af8985224a74df184d (127.17.18.66:46019)
I20260806 19:30:12.643826 1761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:46685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:30:12.678085 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:58935/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:30:13.538697 2274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:30:13.539168 2274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:30:13.539556 2274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:30:13.553746 2274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:30:13.553905 2274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:30:13.554070 2274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:30:13.572095 2274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.18.84:58935/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:36309
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:30:13.574131 2274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:30:13.576231 2274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:30:13.600965 2281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:13.602190 2285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:30:13.602562 2282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:30:13.604974 2274 server_base.cc:1034] running on GCE node
I20260806 19:30:13.606263 2274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:30:13.608047 2274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:30:13.609589 2274 hybrid_clock.cc:648] HybridClock initialized: now 1786044613609411 us; error 53 us; skew 500 ppm
I20260806 19:30:13.610316 2274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:30:13 dist-test-slave-f0tn krb5kdc[1035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044613, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:30:13.620935 2274 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:30:13.624498 2274 webserver.cc:460] Webserver started at http://127.17.18.67:36941/ using document root <none> and password file <none>
I20260806 19:30:13.625799 2274 fs_manager.cc:359] Metadata directory not provided
I20260806 19:30:13.626112 2274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:30:13.626631 2274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:30:13 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044613, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:30:13.647218 2274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "f0d5ef65be024c9c91bdf9316feada24"
format_stamp: "Formatted at 2026-08-06 19:30:13 on dist-test-slave-f0tn"
server_key: "077ea9da3db08377737cea78a772dfa1"
server_key_iv: "d39dc14bdd609305984d008b949d796d"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:13.648486 2274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "f0d5ef65be024c9c91bdf9316feada24"
format_stamp: "Formatted at 2026-08-06 19:30:13 on dist-test-slave-f0tn"
server_key: "077ea9da3db08377737cea78a772dfa1"
server_key_iv: "d39dc14bdd609305984d008b949d796d"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:13.649945 2265 heartbeater.cc:503] Master 127.17.18.126:36309 was elected leader, sending a full tablet report...
I20260806 19:30:13.656932 2274 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.001s
I20260806 19:30:13.679205 2293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:13.681143 2274 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260806 19:30:13.681466 2274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "f0d5ef65be024c9c91bdf9316feada24"
format_stamp: "Formatted at 2026-08-06 19:30:13 on dist-test-slave-f0tn"
server_key: "077ea9da3db08377737cea78a772dfa1"
server_key_iv: "d39dc14bdd609305984d008b949d796d"
server_key_version: "kuduclusterkey@0"
I20260806 19:30:13.681854 2274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:30:13.713711 2274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:30:13.720638 2274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:30:13.721428 2274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:30:13.723066 2274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:30:13.725723 2274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:30:13.725896 2274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:13.726197 2274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:30:13.726347 2274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:30:13.831403 2274 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:42449
I20260806 19:30:13.831458 2453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:42449 every 8 connection(s)
I20260806 19:30:13.833520 2274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:30:13.836099 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 2274
I20260806 19:30:13.836309 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:30:13.836980 17481 external_mini_cluster.cc:1428] Setting key 2d5483f0179aa95d5956c0528d58f58b
Aug 06 19:30:13 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044613, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:30:13.868968 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.837999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:55455 (local address 127.17.18.126:36309)
0806 19:30:13.839202 (+ 1203us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:13.839209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:13.841482 (+ 2273us) server_negotiation.cc:407] Connection header received
0806 19:30:13.844826 (+ 3344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:13.844831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:13.844927 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:13.845051 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:13.847561 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.848839 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.851556 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.852754 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.852893 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.859203 (+ 6310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:13.859211 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:13.859214 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:13.859287 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:13.864015 (+ 4728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:13.865162 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:13.865168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:13.865172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:13.865447 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:13.866334 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:13.866341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:13.866344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:13.866890 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:13.867100 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:13.868021 (+ 921us) server_negotiation.cc:299] Negotiation successful
0806 19:30:13.868343 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1069,"thread_start_us":899,"threads_started":1}
I20260806 19:30:13.870317 2458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.839173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:36309 (local address 127.17.18.67:55455)
0806 19:30:13.841252 (+ 2079us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:13.841307 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:13.844479 (+ 3172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:13.845354 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:13.845364 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:13.846281 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:30:13.847340 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.847366 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.849034 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.849039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.851328 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.851345 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.853204 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.853216 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.853757 (+ 541us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.854880 (+ 1123us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:30:13.854915 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:30:13.858802 (+ 3887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:30:13.864233 (+ 5431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:13.864242 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:13.864260 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:13.864983 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:13.865579 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:30:13.865585 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:30:13.865588 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:30:13.866187 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:30:13.867047 (+ 860us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:30:13.867057 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:30:13.867600 (+ 543us) client_negotiation.cc:769] Sending connection context
0806 19:30:13.867900 (+ 300us) client_negotiation.cc:240] Negotiation successful
0806 19:30:13.868574 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1697,"thread_start_us":1236,"threads_started":1}
I20260806 19:30:13.872263 2454 heartbeater.cc:347] Connected to a master server at 127.17.18.126:36309
I20260806 19:30:13.872750 2454 heartbeater.cc:464] Registering TS with master...
I20260806 19:30:13.874271 2454 heartbeater.cc:511] Master 127.17.18.126:36309 requested a full tablet report, sending...
I20260806 19:30:13.876564 1761 ts_manager.cc:194] Registered new tserver with Master: f0d5ef65be024c9c91bdf9316feada24 (127.17.18.67:42449)
I20260806 19:30:13.878253 1761 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:55455
I20260806 19:30:13.880631 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:30:13.905864 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.888733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.17.18.126:36309)
0806 19:30:13.888937 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:13.888942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:13.889643 (+ 701us) server_negotiation.cc:407] Connection header received
0806 19:30:13.889841 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:13.889847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:13.890006 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:13.890104 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:13.892326 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.893369 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.895080 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.895967 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.896091 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.898922 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:13.898928 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:13.898932 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:13.898971 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:13.902129 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:13.903410 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:13.903416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:13.903418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:13.903598 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:13.904171 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:13.904174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:13.904176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:13.904512 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:13.904732 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:13.905327 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 19:30:13.905611 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 19:30:13.911199 1756 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:30:13.926054 1756 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:30:13.967715 2471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.942574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:46083 (local address 127.0.0.1:40928)
0806 19:30:13.956135 (+ 13561us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:13.956195 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:13.956445 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:13.958698 (+ 2253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:13.958707 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:13.958747 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:30:13.959325 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.959348 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.961503 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.961507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.964163 (+ 2656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.964182 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.966542 (+ 2360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.966548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.966733 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.966777 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 19:30:13.966916 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 19:30:13.967178 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13182,"thread_start_us":13030,"threads_started":1}
I20260806 19:30:13.968851 2473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.943122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:46019 (local address 127.0.0.1:46716)
0806 19:30:13.959807 (+ 16685us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:13.959831 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:13.960007 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:13.961069 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:13.961074 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:13.961131 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:30:13.961743 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.961758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.963367 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.963372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.965433 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.965452 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.967784 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.967791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.968054 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.968088 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:30:13.968161 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 19:30:13.968297 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16521,"mutex_wait_us":35,"thread_start_us":17405,"threads_started":1}
I20260806 19:30:13.969746 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.944155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46716 (local address 127.17.18.66:46019)
0806 19:30:13.959274 (+ 15119us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:13.959283 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:13.960180 (+ 897us) server_negotiation.cc:407] Connection header received
0806 19:30:13.960302 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:13.960310 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:13.960604 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:13.960828 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:30:13.962012 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.963200 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.965618 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.967228 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.967384 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.967642 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:13.969128 (+ 1486us) server_negotiation.cc:299] Negotiation successful
0806 19:30:13.969372 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14928,"thread_start_us":14731,"threads_started":1}
I20260806 19:30:13.970002 2470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.942807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40928 (local address 127.17.18.65:46083)
0806 19:30:13.957470 (+ 14663us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:13.957480 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:13.957518 (+ 38us) server_negotiation.cc:407] Connection header received
0806 19:30:13.957664 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:13.957674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:13.957978 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:13.958326 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:30:13.959647 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.961256 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.964399 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.965905 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.966010 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.966321 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:13.968676 (+ 2355us) server_negotiation.cc:299] Negotiation successful
0806 19:30:13.968885 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14428,"thread_start_us":15030,"threads_started":1}
I20260806 19:30:13.973364 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.944694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56012 (local address 127.17.18.67:42449)
0806 19:30:13.958716 (+ 14022us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:13.958725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:13.960815 (+ 2090us) server_negotiation.cc:407] Connection header received
0806 19:30:13.960950 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:13.960958 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:13.961199 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:13.961438 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:30:13.962349 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.964514 (+ 2165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.968266 (+ 3752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.970053 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.970200 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.971778 (+ 1578us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:13.972779 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0806 19:30:13.972976 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13836,"thread_start_us":13622,"threads_started":1}
I20260806 19:30:13.973649 2472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:13.943468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:42449 (local address 127.0.0.1:56012)
0806 19:30:13.960267 (+ 16799us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:13.960285 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:13.960440 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:13.961440 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:13.961445 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:13.961469 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:30:13.962107 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.962131 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.965631 (+ 3500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.965635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.968049 (+ 2414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:13.968065 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:13.972120 (+ 4055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:13.972131 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:13.972500 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:13.972540 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 19:30:13.972659 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 19:30:13.972814 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16686,"mutex_wait_us":44,"thread_start_us":16013,"threads_started":1}
I20260806 19:30:13.974740 2164 tablet_service.cc:1467] Processing CreateTablet for tablet 427c2da1f79e412897da313aaa099460 (DEFAULT_TABLE table=test-table [id=6b61c27c68504d419295619390222bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:30:13.974822 1969 tablet_service.cc:1467] Processing CreateTablet for tablet 427c2da1f79e412897da313aaa099460 (DEFAULT_TABLE table=test-table [id=6b61c27c68504d419295619390222bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:30:13.977157 1969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c2da1f79e412897da313aaa099460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:30:13.977440 2164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c2da1f79e412897da313aaa099460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:30:13.979388 2366 tablet_service.cc:1467] Processing CreateTablet for tablet 427c2da1f79e412897da313aaa099460 (DEFAULT_TABLE table=test-table [id=6b61c27c68504d419295619390222bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:30:13.981849 2366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 427c2da1f79e412897da313aaa099460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:30:13.999243 2477 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Bootstrap starting.
I20260806 19:30:14.007532 2477 tablet_bootstrap.cc:654] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Neither blocks nor log segments found. Creating new log.
I20260806 19:30:14.010216 2479 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Bootstrap starting.
I20260806 19:30:14.010679 2477 log.cc:824] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:30:14.012593 2484 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Bootstrap starting.
I20260806 19:30:14.018900 2479 tablet_bootstrap.cc:654] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Neither blocks nor log segments found. Creating new log.
I20260806 19:30:14.020375 2484 tablet_bootstrap.cc:654] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Neither blocks nor log segments found. Creating new log.
I20260806 19:30:14.022363 2479 log.cc:824] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Log is configured to *not* fsync() on all Append() calls
I20260806 19:30:14.022425 2484 log.cc:824] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:30:14.026913 2477 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: No bootstrap required, opened a new log
I20260806 19:30:14.027591 2484 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: No bootstrap required, opened a new log
I20260806 19:30:14.027704 2477 ts_tablet_manager.cc:1397] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.014s
I20260806 19:30:14.028018 2484 ts_tablet_manager.cc:1397] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.004s
I20260806 19:30:14.028314 2479 tablet_bootstrap.cc:492] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: No bootstrap required, opened a new log
I20260806 19:30:14.028831 2479 ts_tablet_manager.cc:1397] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.009s
I20260806 19:30:14.043184 2484 raft_consensus.cc:348] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.043928 2484 raft_consensus.cc:374] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:30:14.044191 2484 raft_consensus.cc:729] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eccb09e0b51f49af8985224a74df184d, State: Initialized, Role: FOLLOWER
I20260806 19:30:14.045322 2484 consensus_queue.cc:260] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.047302 2477 raft_consensus.cc:348] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.048200 2477 raft_consensus.cc:374] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:30:14.047873 2479 raft_consensus.cc:348] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.048478 2477 raft_consensus.cc:729] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a08e53440494178821d476a081e392e, State: Initialized, Role: FOLLOWER
I20260806 19:30:14.048774 2479 raft_consensus.cc:374] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:30:14.049060 2479 raft_consensus.cc:729] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d5ef65be024c9c91bdf9316feada24, State: Initialized, Role: FOLLOWER
I20260806 19:30:14.049415 2484 ts_tablet_manager.cc:1428] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Time spent starting tablet: real 0.021s user 0.017s sys 0.004s
I20260806 19:30:14.049737 2477 consensus_queue.cc:260] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.050030 2479 consensus_queue.cc:260] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.052945 2477 ts_tablet_manager.cc:1428] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Time spent starting tablet: real 0.025s user 0.014s sys 0.011s
I20260806 19:30:14.055536 2479 ts_tablet_manager.cc:1428] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Time spent starting tablet: real 0.027s user 0.013s sys 0.010s
I20260806 19:30:14.056494 2454 heartbeater.cc:503] Master 127.17.18.126:36309 was elected leader, sending a full tablet report...
W20260806 19:30:14.087545 2456 tablet.cc:2369] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:30:14.095623 2267 tablet.cc:2369] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:30:14.157965 2489 raft_consensus.cc:482] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:30:14.158473 2489 raft_consensus.cc:504] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.161943 2489 leader_election.cc:288] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a08e53440494178821d476a081e392e (127.17.18.65:46083), f0d5ef65be024c9c91bdf9316feada24 (127.17.18.67:42449)
I20260806 19:30:14.178283 2475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.162394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:50083 (local address 127.17.18.67:42449)
0806 19:30:14.162716 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.162723 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.166214 (+ 3491us) server_negotiation.cc:407] Connection header received
0806 19:30:14.166732 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.166739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.167005 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.167124 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:30:14.168298 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.169199 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.173594 (+ 4395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.176073 (+ 2479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.176381 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.176476 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.177646 (+ 1170us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.177851 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 19:30:14.178736 2470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.162723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:42977 (local address 127.17.18.65:46083)
0806 19:30:14.162994 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.163000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.166364 (+ 3364us) server_negotiation.cc:407] Connection header received
0806 19:30:14.167823 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.167832 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.167936 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.168070 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:30:14.169188 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.170563 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.173952 (+ 3389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.176081 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.176317 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.176411 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.178073 (+ 1662us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.178363 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 19:30:14.180335 2494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.163851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:42449 (local address 127.17.18.66:50083)
0806 19:30:14.166088 (+ 2237us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:14.166106 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:14.166372 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:14.167202 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:14.167212 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:14.167254 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:30:14.168012 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:14.168034 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.169369 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.169410 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:14.173181 (+ 3771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:14.173217 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.176974 (+ 3757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.176987 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:14.177319 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.177369 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 19:30:14.178573 (+ 1204us) client_negotiation.cc:240] Negotiation successful
0806 19:30:14.178813 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2093,"spinlock_wait_cycles":36608,"thread_start_us":1734,"threads_started":1}
I20260806 19:30:14.180478 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.161863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:46083 (local address 127.17.18.66:42977)
0806 19:30:14.165918 (+ 4055us) negotiation.cc:107] Waiting for socket to connect
0806 19:30:14.165989 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 19:30:14.167518 (+ 1529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:30:14.168116 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:30:14.168122 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:30:14.168154 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:30:14.168957 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:14.168974 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.170803 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.170809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:14.173714 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:30:14.173739 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.177142 (+ 3403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.177165 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:30:14.177822 (+ 657us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.177868 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 19:30:14.179088 (+ 1220us) client_negotiation.cc:240] Negotiation successful
0806 19:30:14.179608 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3765,"thread_start_us":2730,"threads_started":1}
I20260806 19:30:14.182801 1996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c2da1f79e412897da313aaa099460" candidate_uuid: "eccb09e0b51f49af8985224a74df184d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a08e53440494178821d476a081e392e" is_pre_election: true
I20260806 19:30:14.184577 1996 raft_consensus.cc:2454] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eccb09e0b51f49af8985224a74df184d in term 0.
I20260806 19:30:14.186017 2391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c2da1f79e412897da313aaa099460" candidate_uuid: "eccb09e0b51f49af8985224a74df184d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d5ef65be024c9c91bdf9316feada24" is_pre_election: true
I20260806 19:30:14.186168 2102 leader_election.cc:302] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a08e53440494178821d476a081e392e, eccb09e0b51f49af8985224a74df184d; no voters:
I20260806 19:30:14.186911 2489 raft_consensus.cc:2781] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:30:14.187134 2489 raft_consensus.cc:482] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:30:14.186945 2391 raft_consensus.cc:2454] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eccb09e0b51f49af8985224a74df184d in term 0.
I20260806 19:30:14.187259 2489 raft_consensus.cc:3037] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 0 FOLLOWER]: Advancing to term 1
W20260806 19:30:14.198427 2053 tablet.cc:2369] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:30:14.249804 2489 raft_consensus.cc:504] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.251253 2489 leader_election.cc:288] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [CANDIDATE]: Term 1 election: Requested vote from peers 3a08e53440494178821d476a081e392e (127.17.18.65:46083), f0d5ef65be024c9c91bdf9316feada24 (127.17.18.67:42449)
I20260806 19:30:14.252072 1996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c2da1f79e412897da313aaa099460" candidate_uuid: "eccb09e0b51f49af8985224a74df184d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a08e53440494178821d476a081e392e"
I20260806 19:30:14.252163 2391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "427c2da1f79e412897da313aaa099460" candidate_uuid: "eccb09e0b51f49af8985224a74df184d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d5ef65be024c9c91bdf9316feada24"
I20260806 19:30:14.252453 1996 raft_consensus.cc:3037] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:30:14.252521 2391 raft_consensus.cc:3037] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:30:14.338227 1996 raft_consensus.cc:2454] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eccb09e0b51f49af8985224a74df184d in term 1.
I20260806 19:30:14.338207 2391 raft_consensus.cc:2454] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eccb09e0b51f49af8985224a74df184d in term 1.
I20260806 19:30:14.339313 2102 leader_election.cc:302] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a08e53440494178821d476a081e392e, eccb09e0b51f49af8985224a74df184d; no voters:
I20260806 19:30:14.339857 2489 raft_consensus.cc:2781] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:30:14.341105 2489 raft_consensus.cc:686] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 1 LEADER]: Becoming Leader. State: Replica: eccb09e0b51f49af8985224a74df184d, State: Running, Role: LEADER
I20260806 19:30:14.342087 2489 consensus_queue.cc:237] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } }
I20260806 19:30:14.350550 1756 catalog_manager.cc:5495] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d reported cstate change: term changed from 0 to 1, leader changed from <none> to eccb09e0b51f49af8985224a74df184d (127.17.18.66). New cstate: current_term: 1 leader_uuid: "eccb09e0b51f49af8985224a74df184d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eccb09e0b51f49af8985224a74df184d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 } health_report { overall_health: UNKNOWN } } }
I20260806 19:30:14.447839 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.439320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46732 (local address 127.17.18.66:46019)
0806 19:30:14.439626 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.439633 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.440266 (+ 633us) server_negotiation.cc:407] Connection header received
0806 19:30:14.440551 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.440555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.440712 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.440857 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:30:14.441615 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.442882 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.445024 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.445762 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.445883 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.446456 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:30:14.447075 (+ 619us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:30:14.447221 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.447340 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.447437 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:30:14.459002 2391 raft_consensus.cc:1261] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 1 FOLLOWER]: Refusing update from remote peer eccb09e0b51f49af8985224a74df184d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:30:14.459048 1996 raft_consensus.cc:1261] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 1 FOLLOWER]: Refusing update from remote peer eccb09e0b51f49af8985224a74df184d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:30:14.460219 2495 consensus_queue.cc:1035] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a08e53440494178821d476a081e392e" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:30:14.460724 2489 consensus_queue.cc:1035] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0d5ef65be024c9c91bdf9316feada24" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:30:14.492823 1756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:30:14.493212 1756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:30:14.498365 1756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8481ca9d854144bce32a2b4eb06864: Sending DeleteTablet for 3 replicas of tablet 427c2da1f79e412897da313aaa099460
I20260806 19:30:14.500020 1969 tablet_service.cc:1514] Processing DeleteTablet for tablet 427c2da1f79e412897da313aaa099460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:30:14 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40928
I20260806 19:30:14.500069 2366 tablet_service.cc:1514] Processing DeleteTablet for tablet 427c2da1f79e412897da313aaa099460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:30:14 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:56012
I20260806 19:30:14.500284 2164 tablet_service.cc:1514] Processing DeleteTablet for tablet 427c2da1f79e412897da313aaa099460 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:30:14 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:46716
I20260806 19:30:14.508965 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 1874
I20260806 19:30:14.514334 2520 tablet_replica.cc:330] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: stopping tablet replica
I20260806 19:30:14.516698 2520 raft_consensus.cc:2229] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:30:14.518680 2520 raft_consensus.cc:2258] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:30:14.524590 2516 tablet_replica.cc:330] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: stopping tablet replica
I20260806 19:30:14.524883 2519 tablet_replica.cc:330] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: stopping tablet replica
I20260806 19:30:14.525312 2519 raft_consensus.cc:2229] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:30:14.525266 2516 raft_consensus.cc:2229] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:30:14.526083 2519 raft_consensus.cc:2258] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:30:14.526160 2516 raft_consensus.cc:2258] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:30:14.528002 2519 ts_tablet_manager.cc:1905] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:30:14.528102 2516 ts_tablet_manager.cc:1905] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:30:14.529253 2520 ts_tablet_manager.cc:1905] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 19:30:14 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:30:14.538548 2519 ts_tablet_manager.cc:1918] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:30:14.538882 2519 log.cc:1196] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/427c2da1f79e412897da313aaa099460
I20260806 19:30:14.538873 2516 ts_tablet_manager.cc:1918] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:30:14.539188 2516 log.cc:1196] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/427c2da1f79e412897da313aaa099460
I20260806 19:30:14.539987 2519 ts_tablet_manager.cc:1939] T 427c2da1f79e412897da313aaa099460 P eccb09e0b51f49af8985224a74df184d: Deleting consensus metadata
I20260806 19:30:14.540129 2516 ts_tablet_manager.cc:1939] T 427c2da1f79e412897da313aaa099460 P f0d5ef65be024c9c91bdf9316feada24: Deleting consensus metadata
I20260806 19:30:14.542824 1734 catalog_manager.cc:4841] TS f0d5ef65be024c9c91bdf9316feada24 (127.17.18.67:42449): tablet 427c2da1f79e412897da313aaa099460 (table test-table [id=6b61c27c68504d419295619390222bc2]) successfully deleted
I20260806 19:30:14.542920 1737 catalog_manager.cc:4841] TS eccb09e0b51f49af8985224a74df184d (127.17.18.66:46019): tablet 427c2da1f79e412897da313aaa099460 (table test-table [id=6b61c27c68504d419295619390222bc2]) successfully deleted
I20260806 19:30:14.550750 2520 ts_tablet_manager.cc:1918] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:30:14.551095 2520 log.cc:1196] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/427c2da1f79e412897da313aaa099460
I20260806 19:30:14.552278 2520 ts_tablet_manager.cc:1939] T 427c2da1f79e412897da313aaa099460 P 3a08e53440494178821d476a081e392e: Deleting consensus metadata
I20260806 19:30:14.555202 1740 catalog_manager.cc:4841] TS 3a08e53440494178821d476a081e392e (127.17.18.65:46083): tablet 427c2da1f79e412897da313aaa099460 (table test-table [id=6b61c27c68504d419295619390222bc2]) successfully deleted
I20260806 19:30:14.557441 2470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.510788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.17.18.65:46083)
0806 19:30:14.511055 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.511063 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.518285 (+ 7222us) server_negotiation.cc:407] Connection header received
0806 19:30:14.518637 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.518645 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.518752 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.518890 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:14.524340 (+ 5450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.525657 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.527946 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.528861 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.528969 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.537910 (+ 8941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:14.537934 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:14.537958 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:14.538059 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:14.552076 (+ 14017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.553449 (+ 1373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.553462 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.553465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.554099 (+ 634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.554755 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.554760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.554764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.555454 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:14.555979 (+ 525us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.556482 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.556708 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260806 19:30:14.558167 2046 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:30:14.676985 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 1874
I20260806 19:30:14.718874 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 2063
Aug 06 19:30:14 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:30:14.737423 2474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.720141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58546 (local address 127.17.18.66:46019)
0806 19:30:14.720359 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.720365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.720451 (+ 86us) server_negotiation.cc:407] Connection header received
0806 19:30:14.720659 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.720664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.720741 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.720830 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:14.722302 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.723316 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.724778 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.725362 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.725609 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.730310 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:14.730330 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:14.730355 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:14.730436 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:14.734173 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.734971 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.734980 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.734982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.735177 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.735588 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.735592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.735594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.736010 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:14.736359 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.736668 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.736929 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:30:14.738217 2257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:30:14.852727 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 2063
I20260806 19:30:14.884652 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 2274
Aug 06 19:30:14 dist-test-slave-f0tn krb5kdc[1035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:30:14.901741 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:30:14.885457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43872 (local address 127.17.18.67:42449)
0806 19:30:14.885996 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0806 19:30:14.886003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:30:14.886024 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:30:14.886177 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:30:14.886182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:30:14.886257 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:30:14.886354 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:30:14.887760 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.888518 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.889921 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:30:14.890363 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:30:14.890480 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:30:14.895207 (+ 4727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:30:14.895228 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:30:14.895247 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:30:14.895310 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:30:14.898373 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.899240 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.899250 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.899252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.899432 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:30:14.899910 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:30:14.899914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:30:14.899916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:30:14.900345 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:30:14.900673 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 19:30:14.901059 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 19:30:14.901349 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":261,"threads_started":1}
I20260806 19:30:14.902472 2444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:30:14.995910 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 2274
I20260806 19:30:15.029449 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 1715
I20260806 19:30:15.030819 1809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:30:15.152464 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 1715
I20260806 19:30:15.191236 17481 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 19:30:15.538257 17481 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 19:30:15.538596 17481 mini_ranger.cc:66] Stopping Ranger...
I20260806 19:30:15.895532 17481 mini_ranger.cc:68] Stopped Ranger
2026-08-06 19:30:15.895 UTC [1081] LOG: received smart shutdown request
2026-08-06 19:30:15.900 UTC [1081] LOG: background worker "logical replication launcher" (PID 1095) exited with exit code 1
2026-08-06 19:30:15.900 UTC [1088] LOG: shutting down
2026-08-06 19:30:16.021 UTC [1081] LOG: database system is shut down
2026-08-06T19:30:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (58319 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:30:16 dist-test-slave-f0tn krb5kdc[2545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:30:16 dist-test-slave-f0tn krb5kdc[2545](info): set up 2 sockets
Aug 06 19:30:16 dist-test-slave-f0tn krb5kdc[2545](info): commencing operation
krb5kdc: starting...
W20260806 19:30:17.404986 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:30:17 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:30:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:30:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangeradmin_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangeradmin_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangerlookup_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangerlookup_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
I20260806 19:30:17.837621 17481 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/postgres -l logfile start
2026-08-06 19:30:20.734 UTC [2585] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 19:30:20.734 UTC [2585] LOG: listening on IPv4 address "127.17.18.84", port 60197
2026-08-06 19:30:20.739 UTC [2585] LOG: listening on Unix socket "/tmp/.s.PGSQL.60197"
2026-08-06 19:30:20.768 UTC [2588] LOG: database system was shut down at 2026-08-06 19:30:18 UTC
2026-08-06 19:30:20.772 UTC [2585] LOG: database system is ready to accept connections
I20260806 19:30:21.880278 17481 mini_postgres.cc:96] Postgres bound to 60197
2026-08-06 19:30:21.905 UTC [2601] FATAL: database "slave" does not exist
127.17.18.84:60197 - accepting connections
I20260806 19:30:21.906484 17481 mini_ranger.cc:161] Starting Ranger...
I20260806 19:30:21.942400 17481 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 19:30:22.550355 17481 mini_ranger.cc:87] Created ranger Postgres database
I20260806 19:30:22.550547 17481 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin
2026-08-06 19:30:22,850 [I] DB FLAVOR :POSTGRES
2026-08-06 19:30:22,850 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 19:30:22,850 [I] Checking connection..
2026-08-06 19:30:22,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 19:30:23,108 [I] Checking connection passed.
2026-08-06 19:30:23,108 [I] --------- Verifying version history table ---------
2026-08-06 19:30:23,108 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:30:23,399 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 19:30:23,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:30:23,678 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 19:30:23,678 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 19:30:23,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 19:30:23.947 UTC [2691] WARNING: there is no transaction in progress
2026-08-06 19:30:23,955 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 19:30:23,955 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 19:30:24,243 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 19:30:24,244 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 19:30:24,244 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 19:30:24,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 19:30:24,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-f0tn.c.gcp-upstream.internal','N') ;"
2026-08-06 19:30:25,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 19:30:25,326 [I] Table x_portal_user does not exist in database ranger
2026-08-06 19:30:25,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 19:30:25,605 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 19:30:25,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 19:30:25,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 19:30:26,180 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 19:30:26,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 19:30:27.316 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.337 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.358 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.376 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.396 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.417 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.488 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.497 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.515 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.527 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.539 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.559 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.572 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.580 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.591 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:27.601 UTC [2845] WARNING: there is no transaction in progress
2026-08-06 19:30:28,483 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 19:30:28,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 19:30:28,736 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 19:30:28,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 19:30:28,995 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 19:30:28,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 19:30:29,283 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 19:30:29,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 19:30:29,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 19:30:29,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-f0tn.c.gcp-upstream.internal';"
2026-08-06 19:30:30,085 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 19:30:30,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 19:30:30,348 [I] DB_PATCHES have already been applied
I20260806 19:30:30.354830 17481 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 19:30:30.354941 17481 mini_ranger.cc:193] Using host: 127.17.18.84
I20260806 19:30:30.378293 17481 mini_ranger.cc:227] Ranger admin URL: http://127.17.18.84:57135
Aug 06, 2026 7:30:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 7:30:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 7:30:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 7:30:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 7:30:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 7:30:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 7:30:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 19:30:32.955937 17481 mini_ranger.cc:160] Time spent starting Ranger: real 11.049s user 0.001s sys 0.083s
Aug 06, 2026 7:30:54 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 7:30:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 7:30:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 7:30:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 7:30:55 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 19:30:56.247126 17481 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.18.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.18.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangerkms_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.18.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/rangerkms_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.18.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.18.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.18.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/HTTP_127.17.18.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 19:30:56 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044656, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 19:30:56.460418 17481 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 19:30:56.490175 17481 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 19:30:57.585429 17481 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 19:30:57.585556 17481 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms
I20260806 19:30:57.585614 17481 mini_ranger_kms.cc:227] Using postgres at 127.17.18.84:60197
2026-08-06 19:30:57,962 [I] DB FLAVOR :POSTGRES
2026-08-06 19:30:57,963 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 19:30:57,963 [I] Checking connection
2026-08-06 19:30:57,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 19:30:58,221 [I] connection success
2026-08-06 19:30:58,221 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 19:30:58,221 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 19:30:58,221 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 19:30:58,473 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 19:30:58,474 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 19:30:58,474 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 19:30:58,474 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.18.84:60197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 19:30:58,758 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 19:30:59.344596 17481 mini_ranger_kms.cc:310] Created kms service
I20260806 19:30:59.547955 17481 mini_ranger_kms.cc:326] Created kudu user
I20260806 19:30:59.600715 17481 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 19:30:59 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044656, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:00.087019 17481 mini_ranger_kms.cc:384] Added ranger policy
I20260806 19:31:00.087432 17481 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNJ4JWZ/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNJ4JWZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 19:31:00.087517 17481 mini_ranger_kms.cc:240] Using host: 127.17.18.84
I20260806 19:31:00.111634 17481 mini_ranger_kms.cc:276] Ranger KMS PID: 3092
I20260806 19:31:00.111774 17481 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.18.84:47067
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 7:31:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 19:31:02 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786044662, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:02.639725 17481 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.179s user 0.072s sys 0.347s
I20260806 19:31:02.639988 17481 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 19:31:02.640164 17481 mini_ranger_kms.cc:401] 127.17.18.84:47067/kms/v1/keys
Aug 06 19:31:03 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044662, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
Aug 06 19:31:03 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044662, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.18.84@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
Aug 06 19:31:05 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:31:06.047194 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45325
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45325
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:06.445591 3167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:06.445935 3167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:06.446035 3167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:06.453926 3167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:06.454061 3167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:06.454109 3167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:06.454188 3167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:06.454270 3167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:06.465799 3167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.18.84:47067/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45325
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:06.467264 3167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:06.468817 3167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:06.481895 3174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:06.481914 3177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:06.482266 3167 server_base.cc:1034] running on GCE node
W20260806 19:31:06.481899 3179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:06.483398 3167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:06.485006 3167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:06.486249 3167 hybrid_clock.cc:648] HybridClock initialized: now 1786044666486181 us; error 47 us; skew 500 ppm
I20260806 19:31:06.486665 3167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:06 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044666, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:06.493561 3167 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:06.495334 3167 webserver.cc:460] Webserver started at http://127.17.18.126:35269/ using document root <none> and password file <none>
I20260806 19:31:06.496050 3167 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:06.496171 3167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:06.496495 3167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:31:06 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044666, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:06.565124 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "76d9498178b04a2a90e16eadc3231b1a"
format_stamp: "Formatted at 2026-08-06 19:31:06 on dist-test-slave-f0tn"
server_key: "c3317e8fed1677aeaa0771a7da51ae18"
server_key_iv: "f6d7acd8ac40992d9b7a69143c98eaff"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:06.566478 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "76d9498178b04a2a90e16eadc3231b1a"
format_stamp: "Formatted at 2026-08-06 19:31:06 on dist-test-slave-f0tn"
server_key: "c3317e8fed1677aeaa0771a7da51ae18"
server_key_iv: "f6d7acd8ac40992d9b7a69143c98eaff"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:06.576502 3167 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260806 19:31:06.605935 3188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:06.611960 3167 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.004s sys 0.001s
I20260806 19:31:06.612355 3167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "76d9498178b04a2a90e16eadc3231b1a"
format_stamp: "Formatted at 2026-08-06 19:31:06 on dist-test-slave-f0tn"
server_key: "c3317e8fed1677aeaa0771a7da51ae18"
server_key_iv: "f6d7acd8ac40992d9b7a69143c98eaff"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:06.612783 3167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:06.635879 3167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:06.642053 3167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:06.642473 3167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:06.666241 3167 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45325
I20260806 19:31:06.666241 3272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45325 every 8 connection(s)
I20260806 19:31:06.668081 3167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:06.672775 3273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:06.676218 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 3167
I20260806 19:31:06.676461 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:31:06.677886 17481 external_mini_cluster.cc:1428] Setting key e91b54a5c73c5d84802d5b8df07b8432
I20260806 19:31:06.692589 3273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Bootstrap starting.
I20260806 19:31:06.697801 3273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:06.699455 3273 log.cc:824] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:06.703485 3273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: No bootstrap required, opened a new log
Aug 06 19:31:06 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:06.712250 3273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:06.712803 3273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:06.712925 3273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76d9498178b04a2a90e16eadc3231b1a, State: Initialized, Role: FOLLOWER
I20260806 19:31:06.713636 3276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:06.680544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.17.18.126:45325)
0806 19:31:06.686636 (+ 6092us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:06.686656 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:06.686729 (+ 73us) server_negotiation.cc:407] Connection header received
0806 19:31:06.691491 (+ 4762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:06.691537 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:06.692327 (+ 790us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:06.693085 (+ 758us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:06.695126 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:06.696657 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:06.698722 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:06.699652 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:06.699832 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:06.704814 (+ 4982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:06.704824 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:06.704843 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:06.704896 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:06.708230 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:06.709102 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:06.709111 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:06.709119 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:06.709299 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:06.709799 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:06.709803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:06.709805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:06.710483 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:06.710845 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:06.711386 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 19:31:06.712058 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5742,"thread_start_us":5654,"threads_started":1}
I20260806 19:31:06.713748 3273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:06.714058 3273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:06.714238 3273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:06.714445 3273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:06.717461 3273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:06.717999 3273 leader_election.cc:302] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76d9498178b04a2a90e16eadc3231b1a; no voters:
I20260806 19:31:06.718619 3273 leader_election.cc:288] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:31:06.718771 3278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:06.719583 3278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 LEADER]: Becoming Leader. State: Replica: 76d9498178b04a2a90e16eadc3231b1a, State: Running, Role: LEADER
I20260806 19:31:06.720197 3278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:06.720938 3273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:06.723414 3280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76d9498178b04a2a90e16eadc3231b1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } } }
I20260806 19:31:06.723783 3280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:06.724699 3284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:06.724576 3281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76d9498178b04a2a90e16eadc3231b1a. Latest consensus state: current_term: 1 leader_uuid: "76d9498178b04a2a90e16eadc3231b1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } } }
I20260806 19:31:06.724916 3281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:06.733434 3284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:06.734686 3273 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 19:31:06.759094 3284 catalog_manager.cc:1347] Generated new cluster ID: 61fec5863f64486bbbaa55714ca78311
I20260806 19:31:06.759281 3284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:06.813800 3284 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:31:06.815953 3284 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:06.825371 3284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Generated new TSK 0
I20260806 19:31:06.826778 3284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:31:07.615487 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:07 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786044667, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 19:31:08.170121 3336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:08.170471 3336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:08.170671 3336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:08.182848 3336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:08.183096 3336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:08.183346 3336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:08.197471 3336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:08.199251 3336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:08.200819 3336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:08.219241 3357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:08.219269 3352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:08.220556 3336 server_base.cc:1034] running on GCE node
W20260806 19:31:08.221973 3351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:08.222841 3336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:08.223954 3336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:08.225238 3336 hybrid_clock.cc:648] HybridClock initialized: now 1786044668225135 us; error 69 us; skew 500 ppm
I20260806 19:31:08.225673 3336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:08 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044668, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:08.230605 3336 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:08.232798 3336 webserver.cc:460] Webserver started at http://127.17.18.65:34881/ using document root <none> and password file <none>
I20260806 19:31:08.233739 3336 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:08.233888 3336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:08.234243 3336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:31:08 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044668, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:08.254879 3336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "c1989144b7d64f069986db116381ee72"
format_stamp: "Formatted at 2026-08-06 19:31:08 on dist-test-slave-f0tn"
server_key: "930ab74d02c596de1c3c32db0a18db16"
server_key_iv: "1c40a9ffb054eccb286ee21aabf139bb"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:08.256342 3336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "c1989144b7d64f069986db116381ee72"
format_stamp: "Formatted at 2026-08-06 19:31:08 on dist-test-slave-f0tn"
server_key: "930ab74d02c596de1c3c32db0a18db16"
server_key_iv: "1c40a9ffb054eccb286ee21aabf139bb"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:08.272330 3336 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.002s sys 0.011s
I20260806 19:31:08.302230 3365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:08.307145 3336 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.003s
I20260806 19:31:08.307540 3336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "c1989144b7d64f069986db116381ee72"
format_stamp: "Formatted at 2026-08-06 19:31:08 on dist-test-slave-f0tn"
server_key: "930ab74d02c596de1c3c32db0a18db16"
server_key_iv: "1c40a9ffb054eccb286ee21aabf139bb"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:08.307950 3336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:08.365077 3336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:08.370146 3336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:08.370500 3336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:08.371656 3336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:08.376863 3336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:08.376973 3336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:08.377143 3336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:08.377250 3336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:08.458061 3527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:44021 every 8 connection(s)
I20260806 19:31:08.458519 3336 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:44021
I20260806 19:31:08.460399 3336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:08.469549 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 3336
I20260806 19:31:08.469784 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
Aug 06 19:31:08 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044667, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:08.470592 17481 external_mini_cluster.cc:1428] Setting key b9209d6728efbcf4361618f12032f13c
Aug 06 19:31:08 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044668, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:08.530313 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:08.468827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.65:43229)
0806 19:31:08.482118 (+ 13291us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:08.482181 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:08.495855 (+ 13674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:08.500789 (+ 4934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:08.500806 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:08.501590 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:08.502586 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:08.502617 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:08.505889 (+ 3272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:08.505896 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:08.507988 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:08.508010 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:08.509442 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:08.509450 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:08.509786 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:08.510680 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:08.510713 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:08.519481 (+ 8768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:08.524618 (+ 5137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:08.524631 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:08.524659 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:08.525466 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:08.526035 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:08.526040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:08.526043 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:08.526344 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:08.527216 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:08.527226 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:08.527819 (+ 593us) client_negotiation.cc:769] Sending connection context
0806 19:31:08.528127 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 19:31:08.528747 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12925,"thread_start_us":12638,"threads_started":1}
I20260806 19:31:08.531786 3533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:08.470119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43229 (local address 127.17.18.126:45325)
0806 19:31:08.489892 (+ 19773us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:08.489899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:08.489927 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:31:08.499760 (+ 9833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:08.499767 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:08.499900 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:08.500031 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:08.502831 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:08.505622 (+ 2791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:08.508253 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:08.508928 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:08.509056 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:08.520040 (+ 10984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:08.520049 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:08.520055 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:08.520211 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:08.524356 (+ 4145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:08.525645 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:08.525652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:08.525655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:08.525887 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:08.526483 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:08.526488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:08.526491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:08.526938 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:08.527106 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:08.531072 (+ 3966us) server_negotiation.cc:299] Negotiation successful
0806 19:31:08.531375 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19610,"thread_start_us":19814,"threads_started":1}
I20260806 19:31:08.534668 3528 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
I20260806 19:31:08.535059 3528 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
I20260806 19:31:08.536120 3528 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
I20260806 19:31:08.539247 3208 ts_manager.cc:194] Registered new tserver with Master: c1989144b7d64f069986db116381ee72 (127.17.18.65:44021)
I20260806 19:31:08.541536 3208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:43229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
W20260806 19:31:08.577543 17481 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.17.18.66: real 0.104s user 0.005s sys 0.024s
I20260806 19:31:08.578357 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:08 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044667, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
W20260806 19:31:09.109817 3543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:09.110386 3543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:09.110590 3543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:09.121592 3543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:09.121869 3543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:09.122083 3543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:09.137669 3543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:09.139674 3543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:09.141525 3543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:09.180752 3559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:09.181826 3560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:09.181990 3563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:09.182585 3543 server_base.cc:1034] running on GCE node
I20260806 19:31:09.183537 3543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:09.191432 3543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:09.193015 3543 hybrid_clock.cc:648] HybridClock initialized: now 1786044669192903 us; error 114 us; skew 500 ppm
I20260806 19:31:09.193558 3543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:09 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044669, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:09.201846 3543 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:09.227288 3543 webserver.cc:460] Webserver started at http://127.17.18.66:42465/ using document root <none> and password file <none>
I20260806 19:31:09.228433 3543 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:09.228601 3543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:09.229002 3543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:31:09 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044669, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:09.252353 3543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "024612ed0af046d5ac676f0689a3734d"
format_stamp: "Formatted at 2026-08-06 19:31:09 on dist-test-slave-f0tn"
server_key: "b50d685b53325b0fdcfbebfcb3671ef7"
server_key_iv: "9137247d2db5718ab53e66c161262715"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:09.254266 3543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "024612ed0af046d5ac676f0689a3734d"
format_stamp: "Formatted at 2026-08-06 19:31:09 on dist-test-slave-f0tn"
server_key: "b50d685b53325b0fdcfbebfcb3671ef7"
server_key_iv: "9137247d2db5718ab53e66c161262715"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:09.275936 3543 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.004s sys 0.015s
I20260806 19:31:09.310189 3582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:09.312566 3543 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.010s sys 0.001s
I20260806 19:31:09.312937 3543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "024612ed0af046d5ac676f0689a3734d"
format_stamp: "Formatted at 2026-08-06 19:31:09 on dist-test-slave-f0tn"
server_key: "b50d685b53325b0fdcfbebfcb3671ef7"
server_key_iv: "9137247d2db5718ab53e66c161262715"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:09.313350 3543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:09.380667 3543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:09.386716 3543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:09.387143 3543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:09.394905 3543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:09.403631 3543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:09.403904 3543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 19:31:09.404129 3543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:09.404245 3543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:09.550397 3528 heartbeater.cc:503] Master 127.17.18.126:45325 was elected leader, sending a full tablet report...
I20260806 19:31:09.604554 3543 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:44793
I20260806 19:31:09.604557 3742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:44793 every 8 connection(s)
I20260806 19:31:09.606586 3543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:31:09.609957 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 3543
I20260806 19:31:09.610177 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:31:09.610731 17481 external_mini_cluster.cc:1428] Setting key 9f27427179187125f6d1c1d6994d34dd
Aug 06 19:31:09 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044669, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:09.648599 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:09.611156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:37843 (local address 127.17.18.126:45325)
0806 19:31:09.628146 (+ 16990us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:09.628153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:09.631559 (+ 3406us) server_negotiation.cc:407] Connection header received
0806 19:31:09.631892 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:09.631899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:09.632002 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:09.632158 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:09.635300 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:09.636140 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:09.637920 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:09.638393 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:09.638519 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:09.642194 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:09.642199 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:09.642202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:09.642241 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:09.644933 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:09.645843 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:09.645849 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:09.645854 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:09.646003 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:09.646488 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:09.646492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:09.646495 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:09.646812 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:09.646966 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:09.647932 (+ 966us) server_negotiation.cc:299] Negotiation successful
0806 19:31:09.648213 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16822,"thread_start_us":16667,"threads_started":1}
I20260806 19:31:09.649938 3745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:09.610461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.66:37843)
0806 19:31:09.628974 (+ 18513us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:09.629060 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:09.631522 (+ 2462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:09.633651 (+ 2129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:09.633667 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:09.634317 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:09.635053 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:09.635076 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:09.636313 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:09.636317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:09.637735 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:09.637759 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:09.638658 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:09.638667 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:09.638934 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:09.639649 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:09.639674 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:09.641905 (+ 2231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:09.645112 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:09.645124 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:09.645146 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:09.645695 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:09.646135 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:09.646140 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:09.646142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:09.646361 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:09.646951 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:09.646961 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:09.647465 (+ 504us) client_negotiation.cc:769] Sending connection context
0806 19:31:09.647773 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 19:31:09.648414 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18010,"thread_start_us":17752,"threads_started":1}
I20260806 19:31:09.651755 3743 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
I20260806 19:31:09.652092 3743 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:09.652928 3743 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:09.655026 3208 ts_manager.cc:194] Registered new tserver with Master: 024612ed0af046d5ac676f0689a3734d (127.17.18.66:44793)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
I20260806 19:31:09.656299 3208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:37843
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:31:09.702244 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:10.090618 3751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:10.090950 3751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:10.091073 3751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:10.098848 3751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:10.098989 3751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:10.099138 3751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:10.109861 3751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:10.111335 3751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:10.112823 3751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:10.127579 3760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:10.127638 3759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:10.127727 3764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:10.128577 3751 server_base.cc:1034] running on GCE node
I20260806 19:31:10.129309 3751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:10.130504 3751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:10.131745 3751 hybrid_clock.cc:648] HybridClock initialized: now 1786044670131679 us; error 66 us; skew 500 ppm
I20260806 19:31:10.132105 3751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044670, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:10.135756 3751 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:10.137565 3751 webserver.cc:460] Webserver started at http://127.17.18.67:35443/ using document root <none> and password file <none>
I20260806 19:31:10.138356 3751 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:10.138494 3751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:10.138841 3751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044670, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:10.156385 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "ea9254a33d8449fca3e121055e09af8a"
format_stamp: "Formatted at 2026-08-06 19:31:10 on dist-test-slave-f0tn"
server_key: "adf333620a8ca6e2e17495be768e6f0d"
server_key_iv: "b636c14c7840cb6bc6c93badac56150e"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:10.157487 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "ea9254a33d8449fca3e121055e09af8a"
format_stamp: "Formatted at 2026-08-06 19:31:10 on dist-test-slave-f0tn"
server_key: "adf333620a8ca6e2e17495be768e6f0d"
server_key_iv: "b636c14c7840cb6bc6c93badac56150e"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:10.164243 3751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 19:31:10.180228 3773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:10.182166 3751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:10.182386 3751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "ea9254a33d8449fca3e121055e09af8a"
format_stamp: "Formatted at 2026-08-06 19:31:10 on dist-test-slave-f0tn"
server_key: "adf333620a8ca6e2e17495be768e6f0d"
server_key_iv: "b636c14c7840cb6bc6c93badac56150e"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:10.182636 3751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:10.197080 3751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:10.201884 3751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:10.202195 3751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:10.203238 3751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:10.204748 3751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:10.204829 3751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:10.204937 3751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:10.204993 3751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:10.237368 3751 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44659
I20260806 19:31:10.237437 3946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44659 every 8 connection(s)
I20260806 19:31:10.238794 3751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:10.241045 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 3751
I20260806 19:31:10.241236 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:31:10.241829 17481 external_mini_cluster.cc:1428] Setting key 87d9194820a68cc8cb5ebf945ca44527
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044670, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:10.262025 3952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:10.241965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:35313 (local address 127.17.18.126:45325)
0806 19:31:10.242781 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:10.242786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:10.243848 (+ 1062us) server_negotiation.cc:407] Connection header received
0806 19:31:10.246530 (+ 2682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:10.246535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:10.246655 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:10.246783 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:10.248580 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.249363 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.251172 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.251695 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.251811 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:10.255529 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:10.255535 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:10.255539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:10.255582 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:10.258703 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.259654 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.259659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.259662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.259823 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.260266 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.260269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.260271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.260558 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:10.260681 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:10.261524 (+ 843us) server_negotiation.cc:299] Negotiation successful
0806 19:31:10.261764 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":302,"threads_started":1}
I20260806 19:31:10.263044 3953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:10.242663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.67:35313)
0806 19:31:10.243569 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:10.243728 (+ 159us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:10.246143 (+ 2415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:10.247087 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:10.247097 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:10.247650 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:10.248316 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:10.248338 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.249575 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.249595 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:10.250975 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:10.250992 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.251952 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.251957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:10.252208 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:10.252961 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:10.252986 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:10.255215 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:10.258859 (+ 3644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:10.258871 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:10.258894 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:10.259525 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:10.259931 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:10.259935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:10.259937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:10.260175 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:10.260677 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:10.260684 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:10.261105 (+ 421us) client_negotiation.cc:769] Sending connection context
0806 19:31:10.261366 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 19:31:10.261883 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":386,"threads_started":1}
I20260806 19:31:10.264523 3947 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
I20260806 19:31:10.264853 3947 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:10.265714 3947 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:10.267439 3208 ts_manager.cc:194] Registered new tserver with Master: ea9254a33d8449fca3e121055e09af8a (127.17.18.67:44659)
I20260806 19:31:10.268296 3208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:35313
I20260806 19:31:10.272058 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:31:10.273759 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 3336
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:31:10.292092 3957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:10.274809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.17.18.65:44021)
0806 19:31:10.275506 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:10.275514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:10.275546 (+ 32us) server_negotiation.cc:407] Connection header received
0806 19:31:10.275610 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:10.275616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:10.275845 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:10.276006 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:10.277610 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.278691 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.280193 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.280798 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.280911 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:10.285656 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:10.285674 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:10.285694 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:10.285745 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:10.288942 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.289833 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.289842 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.289844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.290002 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.290437 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.290441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.290443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.290830 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:10.291079 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:10.291411 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 19:31:10.291679 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":372,"threads_started":1}
I20260806 19:31:10.293835 3518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:10.377920 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 3336
I20260806 19:31:10.403187 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 3543
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:31:10.426683 3960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:10.409005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.17.18.66:44793)
0806 19:31:10.409620 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:10.409628 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:10.409656 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:31:10.409723 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:10.409732 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:10.409971 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:10.410126 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:10.411707 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.412765 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.414400 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.415423 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.415592 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:10.420410 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:10.420428 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:10.420448 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:10.420500 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:10.423639 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.424404 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.424412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.424415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.424567 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.424953 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.424959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.424962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.425339 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:10.425685 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:10.426008 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 19:31:10.426296 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":297,"threads_started":1}
I20260806 19:31:10.428005 3736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:10.515154 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 3543
I20260806 19:31:10.539582 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 3751
Aug 06 19:31:10 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:31:10.558348 3962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:10.540600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34860 (local address 127.17.18.67:44659)
0806 19:31:10.541310 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:10.541318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:10.541349 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:31:10.541442 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:10.541449 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:10.541681 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:10.541905 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:10.543524 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.544609 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.546164 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:10.546796 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:10.546927 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:10.552038 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:10.552057 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:10.552077 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:10.552131 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:10.555216 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.556041 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.556051 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.556053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.556208 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:10.556603 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:10.556606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:10.556608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:10.557005 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:10.557339 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:10.557711 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 19:31:10.557993 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":364,"threads_started":1}
I20260806 19:31:10.559842 3938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:10.645429 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 3751
I20260806 19:31:10.667663 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 3167
I20260806 19:31:10.669034 3268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:10.780966 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 3167
I20260806 19:31:10.815991 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45325
--webserver_interface=127.17.18.126
--webserver_port=35269
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45325
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:11.196053 3967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:11.196614 3967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:11.196825 3967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:11.208567 3967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:11.208761 3967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:11.208845 3967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:11.208930 3967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:11.208994 3967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:11.220319 3967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45325
--ranger_config_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=35269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:11.222302 3967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:11.223874 3967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:11.237038 3979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:11.237164 3976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:11.237061 3977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:11.238158 3967 server_base.cc:1034] running on GCE node
I20260806 19:31:11.239084 3967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:11.240831 3967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:11.242075 3967 hybrid_clock.cc:648] HybridClock initialized: now 1786044671242014 us; error 52 us; skew 500 ppm
I20260806 19:31:11.242503 3967 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:11 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044671, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:11.246014 3967 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:11.247884 3967 webserver.cc:460] Webserver started at http://127.17.18.126:35269/ using document root <none> and password file <none>
I20260806 19:31:11.248646 3967 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:11.248801 3967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 19:31:11 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044671, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:11.301205 3967 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 19:31:11.305007 3989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:11.306802 3967 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:11.307021 3967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "76d9498178b04a2a90e16eadc3231b1a"
format_stamp: "Formatted at 2026-08-06 19:31:06 on dist-test-slave-f0tn"
server_key: "c3317e8fed1677aeaa0771a7da51ae18"
server_key_iv: "f6d7acd8ac40992d9b7a69143c98eaff"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:11.308105 3967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:11.328406 3967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:11.333369 3967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:11.333736 3967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:11.353909 3967 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45325
I20260806 19:31:11.353914 4062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45325 every 8 connection(s)
I20260806 19:31:11.355667 3967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:11.359858 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 3967
I20260806 19:31:11.360724 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:44021
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:45325
--webserver_port=34881
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:11.363638 4063 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:31:11.367403 4063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Bootstrap starting.
I20260806 19:31:11.387857 4063 log.cc:824] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:11.398869 4063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:31:11.399490 4063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Bootstrap complete.
I20260806 19:31:11.408977 4063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:11.410051 4063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76d9498178b04a2a90e16eadc3231b1a, State: Initialized, Role: FOLLOWER
I20260806 19:31:11.410780 4063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:11.411034 4063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:11.411154 4063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:11.411327 4063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 1 FOLLOWER]: Advancing to term 2
I20260806 19:31:11.415832 4063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:11.416419 4063 leader_election.cc:302] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76d9498178b04a2a90e16eadc3231b1a; no voters:
I20260806 19:31:11.417088 4063 leader_election.cc:288] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 19:31:11.417243 4069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 2 FOLLOWER]: Leader election won for term 2
I20260806 19:31:11.423777 4063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:11.424173 4069 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [term 2 LEADER]: Becoming Leader. State: Replica: 76d9498178b04a2a90e16eadc3231b1a, State: Running, Role: LEADER
I20260806 19:31:11.424844 4069 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } }
I20260806 19:31:11.428042 4072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76d9498178b04a2a90e16eadc3231b1a. Latest consensus state: current_term: 2 leader_uuid: "76d9498178b04a2a90e16eadc3231b1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } } }
I20260806 19:31:11.428068 4070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "76d9498178b04a2a90e16eadc3231b1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d9498178b04a2a90e16eadc3231b1a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45325 } } }
I20260806 19:31:11.428604 4072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:11.428721 4070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:11.439458 4075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:11.446581 4075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:11.447575 4063 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 19:31:11.448267 4075 catalog_manager.cc:1259] Loaded cluster ID: 61fec5863f64486bbbaa55714ca78311
I20260806 19:31:11.448359 4075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:11.452689 4075 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:11.454324 4075 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Loaded TSK: 0
I20260806 19:31:11.455988 4075 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:31:11.829797 4067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:11.830276 4067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:11.830499 4067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:11.843003 4067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:11.843297 4067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:11.843576 4067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:11.860251 4067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:44021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=34881
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:11.862655 4067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:11.864809 4067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:11.892289 4114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:11.893481 4112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:11.902869 4117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:11.903470 4067 server_base.cc:1034] running on GCE node
I20260806 19:31:11.904616 4067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:11.906303 4067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:11.907691 4067 hybrid_clock.cc:648] HybridClock initialized: now 1786044671907600 us; error 75 us; skew 500 ppm
I20260806 19:31:11.908164 4067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:11 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044671, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:11.916400 4067 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:11.935359 4067 webserver.cc:460] Webserver started at http://127.17.18.65:34881/ using document root <none> and password file <none>
I20260806 19:31:11.936704 4067 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:11.937016 4067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 19:31:11 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044671, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:11.983978 4067 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.010s sys 0.000s
I20260806 19:31:11.998139 4126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.000443 4067 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.005s sys 0.007s
I20260806 19:31:12.000797 4067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "c1989144b7d64f069986db116381ee72"
format_stamp: "Formatted at 2026-08-06 19:31:08 on dist-test-slave-f0tn"
server_key: "930ab74d02c596de1c3c32db0a18db16"
server_key_iv: "1c40a9ffb054eccb286ee21aabf139bb"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:12.002513 4067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:12.040829 4067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:12.047199 4067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:12.047632 4067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:12.050203 4067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:12.052629 4067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:12.052778 4067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.052903 4067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:12.052980 4067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.109028 4067 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:44021
I20260806 19:31:12.109062 4290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:44021 every 8 connection(s)
I20260806 19:31:12.111265 4067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:12.120585 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 4067
I20260806 19:31:12.121556 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:44793
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:45325
--webserver_port=42465
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:12 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044671, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:12.162282 4297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:12.115776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.65:46699)
0806 19:31:12.127908 (+ 12132us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:12.127982 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:12.130606 (+ 2624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:12.133306 (+ 2700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:12.133348 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:12.134355 (+ 1007us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:12.135803 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:12.135840 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.138454 (+ 2614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.138459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:12.140575 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:12.140599 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.142436 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.142445 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:12.142768 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:12.143672 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:12.143708 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:12.146685 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:12.155830 (+ 9145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:12.155841 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:12.155863 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:12.156680 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:12.157447 (+ 767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:12.157452 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:12.157456 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:12.157784 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:12.159123 (+ 1339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:12.159132 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:12.159627 (+ 495us) client_negotiation.cc:769] Sending connection context
0806 19:31:12.159973 (+ 346us) client_negotiation.cc:240] Negotiation successful
0806 19:31:12.160656 (+ 683us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11804,"thread_start_us":11507,"threads_started":1}
I20260806 19:31:12.165573 4298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:12.116265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:46699 (local address 127.17.18.126:45325)
0806 19:31:12.127338 (+ 11073us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:12.127366 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:12.128577 (+ 1211us) server_negotiation.cc:407] Connection header received
0806 19:31:12.131633 (+ 3056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:12.131657 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:12.132317 (+ 660us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:12.133025 (+ 708us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:12.136127 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.138194 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.140847 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.142115 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.142369 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:12.147143 (+ 4774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:12.147157 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:12.147184 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:12.147244 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:12.155516 (+ 8272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:12.156939 (+ 1423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:12.156952 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:12.156962 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:12.157235 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:12.157954 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:12.157960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:12.157964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:12.158797 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:12.159007 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:12.163380 (+ 4373us) server_negotiation.cc:299] Negotiation successful
0806 19:31:12.163947 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10783,"thread_start_us":10517,"threads_started":1}
I20260806 19:31:12.169519 4291 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
I20260806 19:31:12.169924 4291 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:12.170970 4291 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
W20260806 19:31:12.175311 4291 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:45325 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 19:31:12.175633 4291 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:12.175990 4291 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:12.177678 4291 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:12.178022 4291 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
W20260806 19:31:12.179445 4291 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:31:12.559764 4299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:12.560112 4299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:12.560261 4299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:12.569856 4299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:12.570019 4299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:12.570243 4299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:12.582888 4299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:44793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=42465
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:12.584444 4299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:12.585953 4299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:12.604516 4321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:12.604417 4323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:12.607115 4328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:12.612326 4299 server_base.cc:1034] running on GCE node
I20260806 19:31:12.613590 4299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:12.615144 4299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:12.616475 4299 hybrid_clock.cc:648] HybridClock initialized: now 1786044672616401 us; error 64 us; skew 500 ppm
I20260806 19:31:12.616909 4299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:12 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:12.621419 4299 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:12.623409 4299 webserver.cc:460] Webserver started at http://127.17.18.66:42465/ using document root <none> and password file <none>
I20260806 19:31:12.624255 4299 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:12.624404 4299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 19:31:12 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:12.672870 4299 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.004s sys 0.003s
I20260806 19:31:12.677276 4339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.679425 4299 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:12.679664 4299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "024612ed0af046d5ac676f0689a3734d"
format_stamp: "Formatted at 2026-08-06 19:31:09 on dist-test-slave-f0tn"
server_key: "b50d685b53325b0fdcfbebfcb3671ef7"
server_key_iv: "9137247d2db5718ab53e66c161262715"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:12.681145 4299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:12.697428 4299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:12.703137 4299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:12.703522 4299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:12.706215 4299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:12.708030 4299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:12.708150 4299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.708272 4299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:12.708345 4299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:12.767974 4299 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:44793
I20260806 19:31:12.768028 4522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:44793 every 8 connection(s)
I20260806 19:31:12.770058 4299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
Aug 06 19:31:12 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:12.775908 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 4299
I20260806 19:31:12.776749 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.18.84:47067/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:44659
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:45325
--webserver_port=35443
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:12 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:12.819892 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:12.774022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.66:39271)
0806 19:31:12.788272 (+ 14250us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:12.788336 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:12.792099 (+ 3763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:12.798308 (+ 6209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:12.798324 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:12.799075 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:12.800084 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:12.800121 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.801998 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.802005 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:12.804206 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:12.804229 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.805616 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.805635 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:12.805965 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:12.806834 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:12.806868 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:12.809772 (+ 2904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:12.814163 (+ 4391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:12.814175 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:12.814199 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:12.814939 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:12.815466 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:12.815472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:12.815476 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:12.815815 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:12.816648 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:12.816658 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:12.817177 (+ 519us) client_negotiation.cc:769] Sending connection context
0806 19:31:12.817561 (+ 384us) client_negotiation.cc:240] Negotiation successful
0806 19:31:12.818226 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13892,"thread_start_us":13618,"threads_started":1}
I20260806 19:31:12.821498 4525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:12.773286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:39271 (local address 127.17.18.126:45325)
0806 19:31:12.774608 (+ 1322us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:12.774616 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:12.788510 (+ 13894us) server_negotiation.cc:407] Connection header received
0806 19:31:12.797550 (+ 9040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:12.797558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:12.797680 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:12.797856 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:12.800412 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.801720 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.804491 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:12.805246 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:12.806452 (+ 1206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:12.810138 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:12.810147 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:12.810152 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:12.810215 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:12.813927 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:12.815127 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:12.815132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:12.815136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:12.815313 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:12.815970 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:12.815976 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:12.815978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:12.816397 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:12.816541 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:12.820795 (+ 4254us) server_negotiation.cc:299] Negotiation successful
0806 19:31:12.821078 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1180,"thread_start_us":1030,"threads_started":1}
I20260806 19:31:12.823009 4523 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
I20260806 19:31:12.823362 4523 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:12.824344 4523 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:12.826773 4011 ts_manager.cc:194] Registered new tserver with Master: 024612ed0af046d5ac676f0689a3734d (127.17.18.66:44793)
I20260806 19:31:12.829105 4011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:39271
I20260806 19:31:13.179633 4291 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:13.180158 4291 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:13.181854 4011 ts_manager.cc:194] Registered new tserver with Master: c1989144b7d64f069986db116381ee72 (127.17.18.65:44021)
I20260806 19:31:13.183107 4011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:46699
W20260806 19:31:13.223404 4527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:13.223748 4527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:13.223896 4527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:13.232484 4527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:13.232645 4527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:13.232820 4527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:13.245121 4527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.18.84:47067/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:44659
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=35443
--tserver_master_addrs=127.17.18.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:13.247251 4527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:13.249001 4527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:13.271638 4535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:13.277819 4536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:13.278291 4527 server_base.cc:1034] running on GCE node
W20260806 19:31:13.278620 4539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:13.279724 4527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
Aug 06 19:31:13 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:13.284669 4527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:13.286069 4527 hybrid_clock.cc:648] HybridClock initialized: now 1786044673285717 us; error 321 us; skew 500 ppm
I20260806 19:31:13.286675 4527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:13 dist-test-slave-f0tn krb5kdc[2545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044673, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:13.291422 4527 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:13.307197 4527 webserver.cc:460] Webserver started at http://127.17.18.67:35443/ using document root <none> and password file <none>
I20260806 19:31:13.308354 4527 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:13.308564 4527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 19:31:13 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044673, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:13.371459 4527 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:31:13.375430 4548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:13.377427 4527 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 19:31:13.377632 4527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "ea9254a33d8449fca3e121055e09af8a"
format_stamp: "Formatted at 2026-08-06 19:31:10 on dist-test-slave-f0tn"
server_key: "adf333620a8ca6e2e17495be768e6f0d"
server_key_iv: "b636c14c7840cb6bc6c93badac56150e"
server_key_version: "kuduclusterkey@0"
I20260806 19:31:13.379124 4527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:13.406752 4527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:13.412585 4527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:13.412933 4527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:13.414309 4527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:13.416242 4527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:13.416383 4527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:13.416486 4527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:13.416550 4527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:13.463608 4527 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44659
I20260806 19:31:13.463661 4704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44659 every 8 connection(s)
I20260806 19:31:13.465778 4527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:13.472930 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 4527
Aug 06 19:31:13 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044673, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:13.505412 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.469422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:38955 (local address 127.17.18.126:45325)
0806 19:31:13.481874 (+ 12452us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.481879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.482646 (+ 767us) server_negotiation.cc:407] Connection header received
0806 19:31:13.484904 (+ 2258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.484911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.485025 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.485143 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:13.489198 (+ 4055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.490397 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.492136 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.492942 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.493798 (+ 856us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.498391 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:13.498399 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:13.498403 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:13.498459 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:13.501097 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.502341 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.502347 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.502350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.502520 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.503199 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.503204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.503208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.503606 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:13.503757 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.504747 (+ 990us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.504988 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":753,"server-negotiator.queue_time_us":12324,"thread_start_us":12151,"threads_started":1}
I20260806 19:31:13.506582 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.469940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45325 (local address 127.17.18.67:38955)
0806 19:31:13.482437 (+ 12497us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.482488 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.484430 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.487268 (+ 2838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.487283 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.487981 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:13.488947 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.488980 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.490633 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.490639 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.491961 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.491977 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.494169 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.494179 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.494535 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.495308 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:13.495343 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:13.498059 (+ 2716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:13.501632 (+ 3573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:13.501643 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:13.501666 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:13.502182 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:13.502690 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:13.502695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:13.502699 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:13.503027 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:13.503879 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:13.503889 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:13.504333 (+ 444us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.504604 (+ 271us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.505236 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12167,"thread_start_us":11972,"threads_started":1}
I20260806 19:31:13.508350 4705 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45325
I20260806 19:31:13.508692 4705 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:13.509521 4705 heartbeater.cc:511] Master 127.17.18.126:45325 requested a full tablet report, sending...
I20260806 19:31:13.511194 4011 ts_manager.cc:194] Registered new tserver with Master: ea9254a33d8449fca3e121055e09af8a (127.17.18.67:44659)
I20260806 19:31:13.512336 4011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:38955
I20260806 19:31:13.518467 4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.474125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52434 (local address 127.17.18.126:45325)
0806 19:31:13.485888 (+ 11763us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.485893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.485913 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:13.486100 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.486105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.486170 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.486258 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:13.487948 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.488689 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.492151 (+ 3462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.492942 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.493082 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.497642 (+ 4560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:13.497650 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:13.497655 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:13.497704 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:13.503965 (+ 6261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.510334 (+ 6369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.510340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.510343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.510526 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.512753 (+ 2227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.512759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.512763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.513139 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:13.513455 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.517721 (+ 4266us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.518029 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":11626,"thread_start_us":11611,"threads_started":1}
I20260806 19:31:13.522162 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:31:13.551326 4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.526225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.17.18.126:45325)
0806 19:31:13.526441 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.526447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.530090 (+ 3643us) server_negotiation.cc:407] Connection header received
0806 19:31:13.530279 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.530286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.530393 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.530506 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:13.532717 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.533844 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.535903 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.536493 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.536637 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.540271 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:13.540279 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:13.540284 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:13.540337 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:13.546620 (+ 6283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.547798 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.547805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.547809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.548010 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:13.548586 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:13.548592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:13.548596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:13.549028 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:13.549294 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.550660 (+ 1366us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.550955 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:31:13.558308 4011 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:31:13.570577 4011 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 06 19:31:13 dist-test-slave-f0tn krb5kdc[2545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044672, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for HTTP/127.17.18.84@KRBTEST.COM
I20260806 19:31:13.640489 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.608949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:44793 (local address 127.0.0.1:50074)
0806 19:31:13.625633 (+ 16684us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.625658 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.625830 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.631845 (+ 6015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.631850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.631883 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:13.632292 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.632309 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.634696 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.634702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.637403 (+ 2701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.637423 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.639456 (+ 2033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.639464 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.639689 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.639762 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.639897 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.640102 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16508,"mutex_wait_us":31,"threads_started":1}
I20260806 19:31:13.642884 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.609121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50074 (local address 127.17.18.66:44793)
0806 19:31:13.630742 (+ 21621us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.630752 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.630792 (+ 40us) server_negotiation.cc:407] Connection header received
0806 19:31:13.630921 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.630931 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.631292 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.632550 (+ 1258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:13.632796 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.634504 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.637663 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.639188 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.640728 (+ 1540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.642220 (+ 1492us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.642320 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.642525 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21373,"thread_start_us":22344,"threads_started":1}
I20260806 19:31:13.647619 4421 tablet_service.cc:1467] Processing CreateTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 (DEFAULT_TABLE table=test-table [id=62231d946fbd458096c14795d2c8c0d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:13.649267 4732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.605022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34876 (local address 127.17.18.67:44659)
0806 19:31:13.617898 (+ 12876us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.617908 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.617946 (+ 38us) server_negotiation.cc:407] Connection header received
0806 19:31:13.618059 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.618067 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.618356 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.618588 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:13.633055 (+ 14467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.634847 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.645893 (+ 11046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.647461 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.647580 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.647846 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.648681 (+ 835us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.648868 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12674,"thread_start_us":16409,"threads_started":1}
I20260806 19:31:13.650096 4731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.604685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:44659 (local address 127.0.0.1:34876)
0806 19:31:13.616967 (+ 12282us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.617028 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.617273 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.631077 (+ 13804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.631087 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.631151 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:13.631660 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.631678 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.635080 (+ 3402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.635086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.645653 (+ 10567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.645673 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.648097 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.648103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.648377 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.648413 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.648509 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.649715 (+ 1206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11882,"mutex_wait_us":8273,"thread_start_us":12833,"threads_started":1}
I20260806 19:31:13.652168 4421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16e6630c97a4b62bcb4a86a415d7497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:13.652277 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.618871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49560)
0806 19:31:13.641122 (+ 22251us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.641146 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.641295 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.644763 (+ 3468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.644769 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.644809 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:13.645026 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.645044 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.647613 (+ 2569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.647620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.649507 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.649527 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.651442 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.651449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.651651 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.651688 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.651766 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.651927 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22126,"mutex_wait_us":1,"thread_start_us":7038,"threads_started":1}
I20260806 19:31:13.653448 4740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.618922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.17.18.65:44021)
0806 19:31:13.632708 (+ 13786us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.632719 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.641487 (+ 8768us) server_negotiation.cc:407] Connection header received
0806 19:31:13.641616 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.641625 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.641975 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.645283 (+ 3308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:13.645639 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.647283 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.649750 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.651237 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.652563 (+ 1326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.652816 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.652894 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.653060 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13567,"thread_start_us":13795,"threads_started":1}
I20260806 19:31:13.654500 4619 tablet_service.cc:1467] Processing CreateTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 (DEFAULT_TABLE table=test-table [id=62231d946fbd458096c14795d2c8c0d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:13.655813 4619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16e6630c97a4b62bcb4a86a415d7497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:13.662005 4199 tablet_service.cc:1467] Processing CreateTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 (DEFAULT_TABLE table=test-table [id=62231d946fbd458096c14795d2c8c0d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:13.663846 4199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d16e6630c97a4b62bcb4a86a415d7497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:13.698387 4742 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Bootstrap starting.
I20260806 19:31:13.702569 4742 tablet_bootstrap.cc:654] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:13.704092 4742 log.cc:824] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:13.705423 4744 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Bootstrap starting.
I20260806 19:31:13.707283 4745 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Bootstrap starting.
I20260806 19:31:13.709631 4744 tablet_bootstrap.cc:654] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:13.711136 4744 log.cc:824] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:13.721470 4744 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: No bootstrap required, opened a new log
I20260806 19:31:13.721876 4744 ts_tablet_manager.cc:1397] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.006s
I20260806 19:31:13.725265 4742 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: No bootstrap required, opened a new log
I20260806 19:31:13.725647 4742 ts_tablet_manager.cc:1397] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.006s
I20260806 19:31:13.733477 4744 raft_consensus.cc:348] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.734073 4744 raft_consensus.cc:374] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:13.734206 4744 raft_consensus.cc:729] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024612ed0af046d5ac676f0689a3734d, State: Initialized, Role: FOLLOWER
I20260806 19:31:13.735082 4744 consensus_queue.cc:260] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.735239 4745 tablet_bootstrap.cc:654] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:13.737035 4745 log.cc:824] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:13.743687 4744 ts_tablet_manager.cc:1428] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Time spent starting tablet: real 0.022s user 0.019s sys 0.001s
I20260806 19:31:13.744261 4523 heartbeater.cc:503] Master 127.17.18.126:45325 was elected leader, sending a full tablet report...
I20260806 19:31:13.751330 4742 raft_consensus.cc:348] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.751989 4742 raft_consensus.cc:374] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:13.752103 4742 raft_consensus.cc:729] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9254a33d8449fca3e121055e09af8a, State: Initialized, Role: FOLLOWER
I20260806 19:31:13.755436 4745 tablet_bootstrap.cc:492] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: No bootstrap required, opened a new log
I20260806 19:31:13.755805 4745 ts_tablet_manager.cc:1397] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.005s
I20260806 19:31:13.767010 4745 raft_consensus.cc:348] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.767551 4745 raft_consensus.cc:374] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:13.767664 4745 raft_consensus.cc:729] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1989144b7d64f069986db116381ee72, State: Initialized, Role: FOLLOWER
I20260806 19:31:13.768534 4745 consensus_queue.cc:260] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.770524 4742 consensus_queue.cc:260] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.782272 4291 heartbeater.cc:503] Master 127.17.18.126:45325 was elected leader, sending a full tablet report...
I20260806 19:31:13.783108 4745 ts_tablet_manager.cc:1428] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Time spent starting tablet: real 0.027s user 0.021s sys 0.007s
I20260806 19:31:13.783604 4742 ts_tablet_manager.cc:1428] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Time spent starting tablet: real 0.058s user 0.014s sys 0.003s
I20260806 19:31:13.785060 4705 heartbeater.cc:503] Master 127.17.18.126:45325 was elected leader, sending a full tablet report...
I20260806 19:31:13.785669 4752 raft_consensus.cc:482] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:13.786134 4752 raft_consensus.cc:504] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
W20260806 19:31:13.790436 4524 tablet.cc:2369] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:13.799023 4752 leader_election.cc:288] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea9254a33d8449fca3e121055e09af8a (127.17.18.67:44659), 024612ed0af046d5ac676f0689a3734d (127.17.18.66:44793)
I20260806 19:31:13.802495 4732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.789246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:51977 (local address 127.17.18.67:44659)
0806 19:31:13.789496 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.789503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.794887 (+ 5384us) server_negotiation.cc:407] Connection header received
0806 19:31:13.795044 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.795050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.795150 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.795247 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:13.796166 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.797302 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.799915 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.801171 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.801312 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.801430 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.802082 (+ 652us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.802236 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 19:31:13.803339 4755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.788738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:44659 (local address 127.17.18.65:51977)
0806 19:31:13.794728 (+ 5990us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.794751 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.794913 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.795465 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.795471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.795505 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:13.795956 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.795969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.797495 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.797501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.799701 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.799719 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.801653 (+ 1934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.801660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.801866 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.801900 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.802796 (+ 896us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.802958 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5828,"thread_start_us":5609,"threads_started":1}
I20260806 19:31:13.804510 4650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16e6630c97a4b62bcb4a86a415d7497" candidate_uuid: "c1989144b7d64f069986db116381ee72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9254a33d8449fca3e121055e09af8a" is_pre_election: true
I20260806 19:31:13.805313 4650 raft_consensus.cc:2454] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1989144b7d64f069986db116381ee72 in term 0.
I20260806 19:31:13.806313 4127 leader_election.cc:302] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c1989144b7d64f069986db116381ee72, ea9254a33d8449fca3e121055e09af8a; no voters:
I20260806 19:31:13.806855 4752 raft_consensus.cc:2781] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:31:13.807006 4752 raft_consensus.cc:482] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:31:13.807101 4752 raft_consensus.cc:3037] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:13.810424 4752 raft_consensus.cc:504] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.812248 4752 leader_election.cc:288] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [CANDIDATE]: Term 1 election: Requested vote from peers ea9254a33d8449fca3e121055e09af8a (127.17.18.67:44659), 024612ed0af046d5ac676f0689a3734d (127.17.18.66:44793)
I20260806 19:31:13.812848 4650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16e6630c97a4b62bcb4a86a415d7497" candidate_uuid: "c1989144b7d64f069986db116381ee72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea9254a33d8449fca3e121055e09af8a"
I20260806 19:31:13.813141 4650 raft_consensus.cc:3037] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:13.813234 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.789204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:52159 (local address 127.17.18.66:44793)
0806 19:31:13.789453 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.789460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.797408 (+ 7948us) server_negotiation.cc:407] Connection header received
0806 19:31:13.797747 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.797753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.797839 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.797905 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:13.799329 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.800446 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.807552 (+ 7106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.808892 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.809086 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.809167 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.812771 (+ 3604us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.812958 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:31:13.813992 4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.788881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:44793 (local address 127.17.18.65:52159)
0806 19:31:13.797268 (+ 8387us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:13.797289 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:13.797541 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:13.798126 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:13.798130 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:13.798157 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:13.798569 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.798580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.800654 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.800659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.802681 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:13.802698 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.810783 (+ 8085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.810792 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:13.812089 (+ 1297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.812133 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 19:31:13.813473 (+ 1340us) client_negotiation.cc:240] Negotiation successful
0806 19:31:13.813656 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8242,"thread_start_us":8051,"threads_started":1}
I20260806 19:31:13.815138 4453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16e6630c97a4b62bcb4a86a415d7497" candidate_uuid: "c1989144b7d64f069986db116381ee72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024612ed0af046d5ac676f0689a3734d" is_pre_election: true
I20260806 19:31:13.815804 4453 raft_consensus.cc:2454] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c1989144b7d64f069986db116381ee72 in term 0.
I20260806 19:31:13.816464 4452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16e6630c97a4b62bcb4a86a415d7497" candidate_uuid: "c1989144b7d64f069986db116381ee72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024612ed0af046d5ac676f0689a3734d"
I20260806 19:31:13.816690 4452 raft_consensus.cc:3037] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:13.819662 4452 raft_consensus.cc:2454] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1989144b7d64f069986db116381ee72 in term 1.
I20260806 19:31:13.820672 4130 leader_election.cc:302] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024612ed0af046d5ac676f0689a3734d, c1989144b7d64f069986db116381ee72; no voters:
I20260806 19:31:13.821117 4752 raft_consensus.cc:2781] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:13.822616 4650 raft_consensus.cc:2454] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c1989144b7d64f069986db116381ee72 in term 1.
I20260806 19:31:13.831382 4752 raft_consensus.cc:686] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [term 1 LEADER]: Becoming Leader. State: Replica: c1989144b7d64f069986db116381ee72, State: Running, Role: LEADER
I20260806 19:31:13.832207 4752 consensus_queue.cc:237] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } }
I20260806 19:31:13.847888 4011 catalog_manager.cc:5495] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 reported cstate change: term changed from 0 to 1, leader changed from <none> to c1989144b7d64f069986db116381ee72 (127.17.18.65). New cstate: current_term: 1 leader_uuid: "c1989144b7d64f069986db116381ee72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1989144b7d64f069986db116381ee72" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 44021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 } health_report { overall_health: UNKNOWN } } }
W20260806 19:31:13.870728 4296 tablet.cc:2369] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:13.888871 4740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:13.880179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49574 (local address 127.17.18.65:44021)
0806 19:31:13.880437 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:13.880443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:13.880465 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:31:13.880592 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:13.880598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:13.880727 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:13.880909 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:31:13.881602 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.882801 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.884973 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:13.885758 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:13.885898 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:13.886807 (+ 909us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:31:13.887576 (+ 769us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:31:13.887744 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:13.888451 (+ 707us) server_negotiation.cc:299] Negotiation successful
0806 19:31:13.888556 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:31:13.904685 4452 raft_consensus.cc:1261] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 1 FOLLOWER]: Refusing update from remote peer c1989144b7d64f069986db116381ee72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:13.904695 4650 raft_consensus.cc:1261] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 1 FOLLOWER]: Refusing update from remote peer c1989144b7d64f069986db116381ee72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:13.906243 4752 consensus_queue.cc:1035] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea9254a33d8449fca3e121055e09af8a" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:13.907060 4752 consensus_queue.cc:1035] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024612ed0af046d5ac676f0689a3734d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 44793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:31:13.969833 4706 tablet.cc:2369] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:13.994856 4011 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:13.995193 4011 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:14.000191 4011 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 76d9498178b04a2a90e16eadc3231b1a: Sending DeleteTablet for 3 replicas of tablet d16e6630c97a4b62bcb4a86a415d7497
I20260806 19:31:14.001914 4421 tablet_service.cc:1514] Processing DeleteTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:13 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:50074
I20260806 19:31:14.002357 4619 tablet_service.cc:1514] Processing DeleteTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:13 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:34876
I20260806 19:31:14.003690 4199 tablet_service.cc:1514] Processing DeleteTablet for tablet d16e6630c97a4b62bcb4a86a415d7497 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:13 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:49560
I20260806 19:31:14.010766 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 4067
I20260806 19:31:14.039062 4740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.012585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49588 (local address 127.17.18.65:44021)
0806 19:31:14.013276 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:14.013282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:14.013303 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:31:14.013371 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:14.013410 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:14.013500 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:14.013607 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:14.016179 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.017536 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.019548 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.020268 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.020408 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:14.025622 (+ 5214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:14.025646 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:14.025672 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:14.025728 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:14.030293 (+ 4565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.031987 (+ 1694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.032001 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.032004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.032258 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.033468 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.033475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.033479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.034148 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:14.034537 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:14.036757 (+ 2220us) server_negotiation.cc:299] Negotiation successful
0806 19:31:14.037076 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538}
I20260806 19:31:14.039945 4284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:14.040949 4791 tablet_replica.cc:330] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: stopping tablet replica
I20260806 19:31:14.041571 4791 raft_consensus.cc:2229] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:14.042204 4791 raft_consensus.cc:2258] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:14.043036 4790 tablet_replica.cc:330] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: stopping tablet replica
I20260806 19:31:14.043403 4790 raft_consensus.cc:2229] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:14.043830 4790 raft_consensus.cc:2258] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:14.046104 4791 ts_tablet_manager.cc:1905] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:14.046460 4790 ts_tablet_manager.cc:1905] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:14.053813 4791 ts_tablet_manager.cc:1918] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:14.053813 4790 ts_tablet_manager.cc:1918] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:14.054055 4791 log.cc:1196] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/d16e6630c97a4b62bcb4a86a415d7497
I20260806 19:31:14.054262 4790 log.cc:1196] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/d16e6630c97a4b62bcb4a86a415d7497
I20260806 19:31:14.054632 4791 ts_tablet_manager.cc:1939] T d16e6630c97a4b62bcb4a86a415d7497 P ea9254a33d8449fca3e121055e09af8a: Deleting consensus metadata
I20260806 19:31:14.054965 4790 ts_tablet_manager.cc:1939] T d16e6630c97a4b62bcb4a86a415d7497 P 024612ed0af046d5ac676f0689a3734d: Deleting consensus metadata
I20260806 19:31:14.057195 3991 catalog_manager.cc:4841] TS ea9254a33d8449fca3e121055e09af8a (127.17.18.67:44659): tablet d16e6630c97a4b62bcb4a86a415d7497 (table test-table [id=62231d946fbd458096c14795d2c8c0d2]) successfully deleted
I20260806 19:31:14.057147 3994 catalog_manager.cc:4841] TS 024612ed0af046d5ac676f0689a3734d (127.17.18.66:44793): tablet d16e6630c97a4b62bcb4a86a415d7497 (table test-table [id=62231d946fbd458096c14795d2c8c0d2]) successfully deleted
I20260806 19:31:14.159065 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 4067
I20260806 19:31:14.159179 4793 tablet_replica.cc:330] T d16e6630c97a4b62bcb4a86a415d7497 P c1989144b7d64f069986db116381ee72: stopping tablet replica
W20260806 19:31:14.187067 3991 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.18.65:44021 (error 108)
I20260806 19:31:14.187564 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 4299
I20260806 19:31:14.193367 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.189084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49600)
0806 19:31:14.193040 (+ 3956us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.193159 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3831,"thread_start_us":3705,"threads_started":1}
W20260806 19:31:14.193879 3991 catalog_manager.cc:4584] TS c1989144b7d64f069986db116381ee72 (127.17.18.65:44021): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d16e6630c97a4b62bcb4a86a415d7497: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
I20260806 19:31:14.204941 4736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.188431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.17.18.66:44793)
0806 19:31:14.188879 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:14.188885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:14.188905 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:14.188973 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:14.188979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:14.189064 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:14.189169 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:14.191006 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.192433 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.194270 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.194693 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.194803 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:14.198076 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:14.198094 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:14.198113 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:14.198191 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:14.201427 (+ 3236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.202453 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.202464 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.202468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.202635 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.203142 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.203147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.203150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.203604 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:14.203858 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:14.204310 (+ 452us) server_negotiation.cc:299] Negotiation successful
0806 19:31:14.204568 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323}
I20260806 19:31:14.205889 4518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:14.247929 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.247353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49602)
0806 19:31:14.247622 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.247747 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 19:31:14.249193 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.248750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49616)
0806 19:31:14.248927 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.249027 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 19:31:14.299016 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 4299
I20260806 19:31:14.310091 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.309496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49620)
0806 19:31:14.309788 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.309891 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260806 19:31:14.311431 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.310957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49632)
0806 19:31:14.311141 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.311247 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 19:31:14.323800 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 4527
I20260806 19:31:14.341364 4799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.324614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34880 (local address 127.17.18.67:44659)
0806 19:31:14.325258 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:14.325264 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:14.325286 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:31:14.325353 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:14.325359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:14.325459 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:14.325574 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:14.326915 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.327934 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.329433 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:14.330126 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:14.330300 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:14.333349 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:14.333373 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:14.333436 (+ 63us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:14.333500 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:14.337759 (+ 4259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.338739 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.338752 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.338756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.338971 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:14.339437 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:14.339442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:14.339445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:14.340018 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:14.340344 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:14.340668 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 19:31:14.340934 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":357,"threads_started":1}
I20260806 19:31:14.342280 4699 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:14.392249 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.391702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49644)
0806 19:31:14.391990 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.392094 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260806 19:31:14.393486 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.392999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49650)
0806 19:31:14.393211 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.393286 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 19:31:14.433369 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 4527
I20260806 19:31:14.454005 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 3967
I20260806 19:31:14.455250 4056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:14.571499 4797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:14.570926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:44021 (local address 127.0.0.1:49666)
0806 19:31:14.571157 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:14.571273 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:44021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 19:31:14.571712 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 3967
I20260806 19:31:14.604441 17481 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 19:31:14.952633 17481 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 19:31:14.952880 17481 mini_ranger.cc:66] Stopping Ranger...
I20260806 19:31:15.309978 17481 mini_ranger.cc:68] Stopped Ranger
2026-08-06 19:31:15.310 UTC [2585] LOG: received smart shutdown request
2026-08-06 19:31:15.313 UTC [2585] LOG: background worker "logical replication launcher" (PID 2596) exited with exit code 1
2026-08-06 19:31:15.313 UTC [2590] LOG: shutting down
2026-08-06 19:31:15.482 UTC [2585] LOG: database system is shut down
2026-08-06T19:31:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (59452 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:31:15 dist-test-slave-f0tn krb5kdc[4817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:31:15 dist-test-slave-f0tn krb5kdc[4817](info): set up 2 sockets
Aug 06 19:31:15 dist-test-slave-f0tn krb5kdc[4817](info): commencing operation
krb5kdc: starting...
W20260806 19:31:16.840840 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:31:17 dist-test-slave-f0tn krb5kdc[4817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:31:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:31:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:31:17.166584 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45619
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:17.528086 4836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:17.528405 4836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:17.528529 4836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:17.536019 4836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:17.536194 4836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:17.536275 4836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:17.536339 4836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:17.536384 4836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:17.546861 4836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:17.548256 4836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:17.549677 4836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:17.562426 4845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:17.562386 4846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:17.562470 4848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:17.563560 4836 server_base.cc:1034] running on GCE node
I20260806 19:31:17.564432 4836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:17.565994 4836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:17.567239 4836 hybrid_clock.cc:648] HybridClock initialized: now 1786044677567186 us; error 41 us; skew 500 ppm
I20260806 19:31:17.567623 4836 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:17 dist-test-slave-f0tn krb5kdc[4817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:17.577451 4836 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:17.579288 4836 webserver.cc:460] Webserver started at http://127.17.18.126:38319/ using document root <none> and password file <none>
I20260806 19:31:17.580057 4836 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:17.580174 4836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:17.580457 4836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:17.583865 4836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "ae2106b127914c5facd0ea07777c8b7e"
format_stamp: "Formatted at 2026-08-06 19:31:17 on dist-test-slave-f0tn"
server_key: "bd92b876371184ca20cc973aa38846ef"
server_key_iv: "d973d85caec6bbbce43be2bfa7f08764"
server_key_version: "encryptionkey@0"
I20260806 19:31:17.584784 4836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "ae2106b127914c5facd0ea07777c8b7e"
format_stamp: "Formatted at 2026-08-06 19:31:17 on dist-test-slave-f0tn"
server_key: "bd92b876371184ca20cc973aa38846ef"
server_key_iv: "d973d85caec6bbbce43be2bfa7f08764"
server_key_version: "encryptionkey@0"
I20260806 19:31:17.590611 4836 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 19:31:17.594521 4860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:17.596002 4836 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:31:17.596181 4836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "ae2106b127914c5facd0ea07777c8b7e"
format_stamp: "Formatted at 2026-08-06 19:31:17 on dist-test-slave-f0tn"
server_key: "bd92b876371184ca20cc973aa38846ef"
server_key_iv: "d973d85caec6bbbce43be2bfa7f08764"
server_key_version: "encryptionkey@0"
I20260806 19:31:17.596390 4836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:17.617194 4836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:17.621937 4836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:17.622226 4836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:17.641821 4836 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45619
I20260806 19:31:17.641846 4935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45619 every 8 connection(s)
I20260806 19:31:17.643288 4836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:17.647414 4936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:17.648504 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 4836
I20260806 19:31:17.648784 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:31:17.649500 17481 external_mini_cluster.cc:1428] Setting key 97b8925c1d3baee00ae6bd1089a26cc5
I20260806 19:31:17.654765 4936 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:31:17 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.125@KRBTEST.COM" created.
I20260806 19:31:17.680333 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.658542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45619 (local address 127.0.0.1:44368)
0806 19:31:17.659480 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.659530 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:17.661769 (+ 2239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:17.662643 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:17.662650 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:17.663375 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:17.663740 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:17.663759 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:17.665722 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:17.665727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:17.666861 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:17.666875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:17.667920 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:17.667927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:17.668117 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:17.668780 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:17.668805 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:17.671404 (+ 2599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:17.675636 (+ 4232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:17.675651 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:17.675665 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:17.676125 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:17.676653 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:17.676657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:17.676659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:17.676845 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:17.677793 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:17.677806 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:17.678022 (+ 216us) client_negotiation.cc:769] Sending connection context
0806 19:31:17.678274 (+ 252us) client_negotiation.cc:240] Negotiation successful
0806 19:31:17.678961 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":169,"thread_start_us":407,"threads_started":1}
I20260806 19:31:17.680397 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.660024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44368 (local address 127.17.18.126:45619)
0806 19:31:17.660759 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:17.660771 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:17.660841 (+ 70us) server_negotiation.cc:407] Connection header received
0806 19:31:17.662159 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:17.662165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:17.662413 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:17.662606 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:17.663944 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:17.665557 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:17.667007 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:17.667661 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:17.667869 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:17.671719 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:17.671728 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:17.671744 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:17.671779 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:17.675465 (+ 3686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:17.676284 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:17.676294 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:17.676297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:17.676517 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:17.676970 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:17.676973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:17.676975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:17.677652 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:17.677859 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:17.678418 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 19:31:17.678834 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":513,"thread_start_us":354,"threads_started":1}
I20260806 19:31:17.684871 4936 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:17.686358 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.685816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39440)
0806 19:31:17.686033 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.686168 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260806 19:31:17.686704 4865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
I20260806 19:31:17.688581 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.688138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39452)
0806 19:31:17.688317 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.688393 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 19:31:17.688817 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:40047: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
I20260806 19:31:17.716895 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:40047
--webserver_interface=127.17.18.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:17.738175 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } attempt: 1
I20260806 19:31:17.739622 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.739038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39466)
0806 19:31:17.739277 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.739445 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 19:31:17.740799 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.740376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39476)
0806 19:31:17.740557 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.740638 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 19:31:17.741015 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:40047: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
I20260806 19:31:17.809336 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } attempt: 2
I20260806 19:31:17.810648 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.810122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39486)
0806 19:31:17.810396 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.810495 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 19:31:17.811806 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.811401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39496)
0806 19:31:17.811574 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.811652 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 19:31:17.812014 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:40047: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
I20260806 19:31:17.903309 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } attempt: 3
I20260806 19:31:17.904531 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.904054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39506)
0806 19:31:17.904277 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.904390 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 19:31:17.905714 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:17.905276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39510)
0806 19:31:17.905469 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:17.905550 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 19:31:17.905905 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:40047: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
I20260806 19:31:18.049196 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } attempt: 4
I20260806 19:31:18.050453 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.049898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39512)
0806 19:31:18.050217 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.050309 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260806 19:31:18.051496 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.051105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39514)
0806 19:31:18.051261 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.051361 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 19:31:18.051712 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:40047: Network error: Client connection negotiation failed: client connection to 127.17.18.125:40047: connect: Connection refused (error 111)
W20260806 19:31:18.086127 4947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:18.086479 4947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:18.086633 4947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:18.094246 4947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:18.094389 4947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:18.094475 4947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:18.094556 4947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:18.094630 4947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:18.107080 4947 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:40047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.18.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:18.108642 4947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:18.110152 4947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:18.123170 4955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:18.123088 4960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:18.123126 4954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:18.127169 4947 server_base.cc:1034] running on GCE node
I20260806 19:31:18.128180 4947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:18.129828 4947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:18.131058 4947 hybrid_clock.cc:648] HybridClock initialized: now 1786044678130991 us; error 54 us; skew 500 ppm
I20260806 19:31:18.131417 4947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:18.134814 4947 init.cc:377] Logged in from keytab as kudu/127.17.18.125@KRBTEST.COM (short username kudu)
I20260806 19:31:18.136523 4947 webserver.cc:460] Webserver started at http://127.17.18.125:42829/ using document root <none> and password file <none>
I20260806 19:31:18.137326 4947 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:18.137486 4947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:18.137836 4947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:18.141135 4947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data/instance:
uuid: "1e8427c54f2147c38779d2e4942433e2"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "c05b860556de0c02d72090ba28e7f1da"
server_key_iv: "bebfc2d7ccedcdbe23602bd450da55b4"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.142134 4947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal/instance:
uuid: "1e8427c54f2147c38779d2e4942433e2"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "c05b860556de0c02d72090ba28e7f1da"
server_key_iv: "bebfc2d7ccedcdbe23602bd450da55b4"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.148367 4947 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:31:18.152671 4973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:18.154613 4947 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:18.154863 4947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "1e8427c54f2147c38779d2e4942433e2"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "c05b860556de0c02d72090ba28e7f1da"
server_key_iv: "bebfc2d7ccedcdbe23602bd450da55b4"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.155088 4947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:18.174322 4947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:18.179407 4947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:18.179733 4947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:18.199591 4947 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.125:40047
I20260806 19:31:18.199713 5042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.125:40047 every 8 connection(s)
I20260806 19:31:18.201306 4947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
I20260806 19:31:18.205617 5043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:18.209626 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 4947
I20260806 19:31:18.209829 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-1/wal/instance
I20260806 19:31:18.210287 17481 external_mini_cluster.cc:1428] Setting key ea71ac2f7cf42628fd0aba9002cddbf0
I20260806 19:31:18.213249 5043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:18.236900 5045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.216350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44376 (local address 127.17.18.126:45619)
0806 19:31:18.216876 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.216880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.218204 (+ 1324us) server_negotiation.cc:407] Connection header received
0806 19:31:18.220284 (+ 2080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.220290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.220374 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.220472 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.222218 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.223038 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.224704 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.225153 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.225281 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.229606 (+ 4325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.229612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.229615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.229671 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.232645 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.233978 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.233985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.233987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.234139 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.234767 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.234772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.234774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.235151 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.235295 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.236382 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.236605 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":290,"threads_started":1}
WARNING: no policy specified for kudu/127.17.18.124@KRBTEST.COM; defaulting to no policy
I20260806 19:31:18.238652 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.217035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45619 (local address 127.0.0.1:44376)
0806 19:31:18.217993 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.218047 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.219960 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.220746 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.220755 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.221326 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.221998 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.222016 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.223222 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.223227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.224535 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.224549 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.225461 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.225471 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.225720 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.226560 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.226587 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.229216 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.232920 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.232932 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.232955 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.233788 (+ 833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.234278 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.234284 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.234288 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.234588 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.235301 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.235311 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.235896 (+ 585us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.236240 (+ 344us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.236854 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":418,"threads_started":1}
I20260806 19:31:18.240767 5043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.124@KRBTEST.COM" created.
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:31:18.256680 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.241867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39520)
0806 19:31:18.242072 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.242093 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.242226 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.243331 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.243336 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.243810 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.243955 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.243965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.245369 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.245400 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.246351 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.246365 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.247268 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.247274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.247468 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.248087 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.248103 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.250466 (+ 2363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.253913 (+ 3447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.253918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.253921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.254292 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.254766 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.254770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.254772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.254941 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.255657 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.255661 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.255803 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.255948 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.256289 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 19:31:18.256763 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.242155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39520 (local address 127.17.18.125:40047)
0806 19:31:18.242872 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.242878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.242905 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:31:18.242954 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.242960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.243165 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.243315 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.244117 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.245220 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.246505 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.247110 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.247239 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.250696 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.250710 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.250727 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.250764 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.253748 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.254434 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.254444 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.254447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.254613 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.255054 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.255059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.255061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.255517 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.255694 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.256158 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.256391 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":427,"threads_started":1}
I20260806 19:31:18.259764 5043 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:18.261006 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.260498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58244)
0806 19:31:18.260692 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.260844 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 19:31:18.261255 4976 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.262867 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.262523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58248)
0806 19:31:18.262672 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.262755 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 19:31:18.263069 5043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
I20260806 19:31:18.281913 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:33081
--webserver_interface=127.17.18.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:18.312403 5043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 1
I20260806 19:31:18.313696 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.313140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58254)
0806 19:31:18.313345 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.313495 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:31:18.314862 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.314491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58258)
0806 19:31:18.314652 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.314735 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 19:31:18.315073 5043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.350994 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } attempt: 5
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:31:18.364934 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.351898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.17.18.125:40047)
0806 19:31:18.352106 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.352112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.352136 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:31:18.352274 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.352280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.352370 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.352455 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.353349 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.354107 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.355354 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.355841 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.355959 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.359570 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.359575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.359579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.359615 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.362318 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.362992 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.362996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.362999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.363125 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.363490 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.363494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.363496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.363793 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.363928 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.364384 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.364637 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:31:18.364935 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.351759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39536)
0806 19:31:18.351970 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.351994 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.352141 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.352524 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.352530 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.352949 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.353170 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.353180 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.354253 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.354259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.355196 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.355222 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.355996 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.356002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.356194 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.356860 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.356880 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.359353 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.362472 (+ 3119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.362479 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.362484 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.362871 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.363235 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.363240 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.363244 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.363385 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.363913 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.363917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.364111 (+ 194us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.364261 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.364564 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 19:31:18.366091 4936 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:18.367205 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.366775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58262)
0806 19:31:18.366948 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.367040 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 19:31:18.368104 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.367771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58278)
0806 19:31:18.367908 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.367993 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 19:31:18.368294 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.383315 5043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 2
I20260806 19:31:18.384451 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.383985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58290)
0806 19:31:18.384187 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.384284 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:31:18.385442 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.385068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58298)
0806 19:31:18.385214 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.385284 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 19:31:18.385705 5043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.419569 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 1
I20260806 19:31:18.420849 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.420341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58300)
0806 19:31:18.420551 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.420678 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 19:31:18.421922 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.421571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58310)
0806 19:31:18.421735 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.421809 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 19:31:18.422140 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.476927 5043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 3
I20260806 19:31:18.478101 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.477620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58324)
0806 19:31:18.477820 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.477927 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 19:31:18.479306 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.478845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58330)
0806 19:31:18.479088 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.479177 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260806 19:31:18.479523 5043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.490368 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 2
I20260806 19:31:18.491562 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.491047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58340)
0806 19:31:18.491287 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.491381 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 19:31:18.492641 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.492256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58350)
0806 19:31:18.492438 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.492515 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 19:31:18.492853 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.599123 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 3
I20260806 19:31:18.600414 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.599908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58358)
0806 19:31:18.600129 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.600231 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 19:31:18.601625 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.601138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58362)
0806 19:31:18.601362 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.601492 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260806 19:31:18.601852 4936 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
I20260806 19:31:18.622747 5043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 4
I20260806 19:31:18.623982 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.623448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58374)
0806 19:31:18.623712 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.623806 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 19:31:18.625038 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.624634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58382)
0806 19:31:18.624802 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.624884 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 19:31:18.625258 5043 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:33081: Network error: Client connection negotiation failed: client connection to 127.17.18.124:33081: connect: Connection refused (error 111)
W20260806 19:31:18.651922 5057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:18.652261 5057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:18.652407 5057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:18.660137 5057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:18.660290 5057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:18.660393 5057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:18.660476 5057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:18.660538 5057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:18.671157 5057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45619,127.17.18.125:40047,127.17.18.124:33081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:33081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.18.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:18.672612 5057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:18.674301 5057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:18.686746 5065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:18.686827 5068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:18.686734 5066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:18.687779 5057 server_base.cc:1034] running on GCE node
I20260806 19:31:18.688658 5057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:18.690306 5057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:18.691565 5057 hybrid_clock.cc:648] HybridClock initialized: now 1786044678691509 us; error 41 us; skew 500 ppm
I20260806 19:31:18.692010 5057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:18.695452 5057 init.cc:377] Logged in from keytab as kudu/127.17.18.124@KRBTEST.COM (short username kudu)
I20260806 19:31:18.697110 5057 webserver.cc:460] Webserver started at http://127.17.18.124:34761/ using document root <none> and password file <none>
I20260806 19:31:18.697891 5057 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:18.698002 5057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:18.698282 5057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:18.701625 5057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data/instance:
uuid: "9c6b33c6919049838a77020d4c13ebd9"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "dd78840d52630fb63e234e175f0b8a76"
server_key_iv: "530c3c42b5b566fb6f65733793dfc03b"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.702546 5057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal/instance:
uuid: "9c6b33c6919049838a77020d4c13ebd9"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "dd78840d52630fb63e234e175f0b8a76"
server_key_iv: "530c3c42b5b566fb6f65733793dfc03b"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.708515 5057 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:31:18.712541 5079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:18.714161 5057 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:18.714349 5057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "9c6b33c6919049838a77020d4c13ebd9"
format_stamp: "Formatted at 2026-08-06 19:31:18 on dist-test-slave-f0tn"
server_key: "dd78840d52630fb63e234e175f0b8a76"
server_key_iv: "530c3c42b5b566fb6f65733793dfc03b"
server_key_version: "encryptionkey@0"
I20260806 19:31:18.714560 5057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:18.737818 5057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:18.742568 5057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:18.742877 5057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:18.762055 5057 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.124:33081
I20260806 19:31:18.762079 5154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.124:33081 every 8 connection(s)
I20260806 19:31:18.763496 5057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
I20260806 19:31:18.767553 5155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:18.773877 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5057
I20260806 19:31:18.774118 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786044445493736-17481-0/minicluster-data/master-2/wal/instance
I20260806 19:31:18.774734 17481 external_mini_cluster.cc:1428] Setting key f752ae277849259c1409643d7521a05c
I20260806 19:31:18.774971 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:18.779076 4936 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 4
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:31:18.798501 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.779652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58412)
0806 19:31:18.779832 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.779852 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.779968 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.781565 (+ 1597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.781570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.782131 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.782339 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.782352 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.784706 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.784712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.786253 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.786270 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.787354 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.787359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.787552 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.788174 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.788198 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.790654 (+ 2456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.795390 (+ 4736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.795396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.795400 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.795789 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.796287 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.796292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.796295 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.796444 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.797503 (+ 1059us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.797508 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.797682 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.797805 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.798123 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 19:31:18.799355 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.778199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44382 (local address 127.17.18.126:45619)
0806 19:31:18.778896 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.778902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.779017 (+ 115us) server_negotiation.cc:407] Connection header received
0806 19:31:18.781265 (+ 2248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.781270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.781360 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.782406 (+ 1046us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.783300 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.784351 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.786182 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.786757 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.786883 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.791346 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.791353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.791358 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.791397 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.794780 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.795945 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.795950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.795954 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.796104 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.796526 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.796531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.796534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.796872 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.797041 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.798736 (+ 1695us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.798963 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":431,"threads_started":1}
I20260806 19:31:18.799628 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.779829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.17.18.124:33081)
0806 19:31:18.780674 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.780680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.780708 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:31:18.780967 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.780985 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.781305 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.782156 (+ 851us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.782564 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.784568 (+ 2004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.786408 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.787206 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.787345 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.790947 (+ 3602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.790957 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.790973 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.791028 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.795254 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.795927 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.795938 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.795941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.796118 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.796603 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.796608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.796611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.797360 (+ 749us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.797589 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.797963 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.798342 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":237,"server-negotiator.queue_time_us":719,"spinlock_wait_cycles":6400,"thread_start_us":521,"threads_started":1}
I20260806 19:31:18.799975 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.776870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.17.18.124:33081)
0806 19:31:18.777811 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.777826 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.777876 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:31:18.780952 (+ 3076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.780985 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.781305 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.781538 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.783273 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.784412 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.786469 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.787214 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.787911 (+ 697us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.792513 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.792519 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.792522 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.792558 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.795875 (+ 3317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.796847 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.796852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.796854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.796974 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.797462 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.797466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.797469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.797798 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.798060 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.798955 (+ 895us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.799168 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":644,"server-negotiator.queue_time_us":696,"spinlock_wait_cycles":49408,"thread_start_us":411,"threads_started":1}
I20260806 19:31:18.800522 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.778090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45619 (local address 127.0.0.1:44382)
0806 19:31:18.778863 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.778919 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.780952 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.781615 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.781622 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.782577 (+ 955us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.783094 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.783119 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.784568 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.784573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.786031 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.786050 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.787006 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.787014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.787266 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.788093 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.788123 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.791113 (+ 2990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.794951 (+ 3838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.794966 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.794982 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.795780 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.796229 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.796234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.796238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.796414 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.797016 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.797025 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.797296 (+ 271us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.797630 (+ 334us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.798204 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"spinlock_wait_cycles":17536,"thread_start_us":299,"threads_started":1}
I20260806 19:31:18.802774 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:18.808404 4936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: Bootstrap starting.
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:31:18.812856 4936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:18.814414 4936 log.cc:824] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:18.818532 4936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: No bootstrap required, opened a new log
I20260806 19:31:18.819736 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.803527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:40047 (local address 127.0.0.1:39550)
0806 19:31:18.803963 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.803981 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.804060 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.804668 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.804674 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.805046 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.805219 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.805229 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.806640 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.806646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.807962 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.807978 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.808758 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.808764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.808973 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.809724 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.809750 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.812417 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.816478 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.816484 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.816487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.816925 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.817585 (+ 660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.817590 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.817594 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.817814 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.818572 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.818577 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.818779 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.818950 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.819353 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310}
I20260806 19:31:18.819759 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.804056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39550 (local address 127.17.18.125:40047)
0806 19:31:18.804252 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.804258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.804281 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:31:18.804344 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.804349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.804430 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.804670 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.805392 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.806453 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.808126 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.808588 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.808710 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.812701 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.812709 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.812714 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.812762 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.816275 (+ 3513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.817075 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.817081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.817085 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.817428 (+ 343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.817984 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.817989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.817993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.818404 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.818558 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.819085 (+ 527us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.819354 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:31:18.821442 5155 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:31:18.824782 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.805574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44394 (local address 127.17.18.126:45619)
0806 19:31:18.805821 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.805826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.805842 (+ 16us) server_negotiation.cc:407] Connection header received
0806 19:31:18.805888 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.805892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.805981 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.806069 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.807856 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.808927 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.810741 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.811389 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.811554 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.817140 (+ 5586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.817145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.817148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.817194 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.821193 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.822300 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.822307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.822310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.822477 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.822940 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.822946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.822949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.823390 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.823673 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.824195 (+ 522us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.824435 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:31:18.830837 4936 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.831375 4936 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:18.831544 4936 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae2106b127914c5facd0ea07777c8b7e, State: Initialized, Role: FOLLOWER
I20260806 19:31:18.832267 4936 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.833523 5164 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:18.834097 5164 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:18.835187 4936 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:31:18.838577 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.822321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58418)
0806 19:31:18.822935 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.822953 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.823073 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.823410 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.823416 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.823942 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.824158 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.824171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.825529 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.825534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.826881 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.826898 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.828028 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.828033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.828208 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.828890 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.828909 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.831473 (+ 2564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.835541 (+ 4068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.835546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.835550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.836066 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.836494 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.836499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.836502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.836698 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.837470 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.837476 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.837687 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.837830 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.838155 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498}
I20260806 19:31:18.838639 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.822757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58418 (local address 127.17.18.124:33081)
0806 19:31:18.822948 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.822954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.823006 (+ 52us) server_negotiation.cc:407] Connection header received
0806 19:31:18.823191 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.823196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.823271 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.823373 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.824313 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.825356 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.827034 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.827681 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.827781 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.831696 (+ 3915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.831703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.831708 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.831750 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.835371 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.836207 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.836212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.836215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.836369 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.836814 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.836818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.836821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.837301 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.837511 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.837946 (+ 435us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.838311 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":146,"server-negotiator.queue_time_us":64}
I20260806 19:31:18.843977 5155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: Bootstrap starting.
I20260806 19:31:18.845253 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.826606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39564 (local address 127.17.18.125:40047)
0806 19:31:18.826769 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.826773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.826984 (+ 211us) server_negotiation.cc:407] Connection header received
0806 19:31:18.827136 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.827142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.827211 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.827292 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.828624 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.829803 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.831277 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.831865 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.831992 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.837074 (+ 5082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.837079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.837083 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.837123 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.841230 (+ 4107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.842376 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.842383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.842387 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.842594 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.843126 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.843131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.843135 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.843530 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.843841 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.844496 (+ 655us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.844845 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 19:31:18.848294 5155 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:18.849884 5155 log.cc:824] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:18.851639 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:31:18.853587 4836 master_runner.cc:186] Error getting master registration for 127.17.18.125:40047: OK, instance_id { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" instance_seqno: 1786044678193916 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:31:18.866065 4836 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 19:31:18.869450 5155 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: No bootstrap required, opened a new log
W20260806 19:31:18.869701 5178 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:31:18.869923 5178 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260806 19:31:18.875505 4867 tablet.cc:2369] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:18.879061 5155 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.879799 5155 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:18.879993 5155 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c6b33c6919049838a77020d4c13ebd9, State: Initialized, Role: FOLLOWER
I20260806 19:31:18.881018 5155 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.898748 5155 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:18.896963 5190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:18.901908 5190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:18.919648 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.876566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44404 (local address 127.17.18.126:45619)
0806 19:31:18.876749 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.876755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.886054 (+ 9299us) server_negotiation.cc:407] Connection header received
0806 19:31:18.886412 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.886419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.886626 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.886740 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.896381 (+ 9641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.897630 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.900093 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.900928 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.901053 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.906094 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.906102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.906109 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.906196 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.910846 (+ 4650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.911870 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.911877 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.911881 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.912067 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.912581 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.912587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.912590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.916942 (+ 4352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.917315 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.918741 (+ 1426us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.919158 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 19:31:18.924477 5043 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } attempt: 5
I20260806 19:31:18.925626 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.886279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.17.18.124:33081)
0806 19:31:18.886495 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.886501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.896294 (+ 9793us) server_negotiation.cc:407] Connection header received
0806 19:31:18.897728 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.897734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.897828 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.897911 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.901988 (+ 4077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.903442 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.905942 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.906728 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.906877 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.915344 (+ 8467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.915380 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.915388 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.915451 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.919639 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.922812 (+ 3173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.922819 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.922822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.923016 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.923555 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.923561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.923565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.924042 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.924295 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.924940 (+ 645us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.925215 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:31:18.926220 5048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.877529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39566 (local address 127.17.18.125:40047)
0806 19:31:18.877741 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.877747 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.889078 (+ 11331us) server_negotiation.cc:407] Connection header received
0806 19:31:18.889656 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.889663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.889755 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.889832 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.892330 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.893543 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.900331 (+ 6788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.901041 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.901160 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.911933 (+ 10773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.911942 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.911948 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.912005 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.916012 (+ 4007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.921944 (+ 5932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.921952 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.921957 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.922208 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.923226 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.923232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.923235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.923697 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.923999 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.925332 (+ 1333us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.925777 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 19:31:18 dist-test-slave-f0tn krb5kdc[4817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044678, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:31:18.945068 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.925113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:33081 (local address 127.0.0.1:58426)
0806 19:31:18.925982 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:18.926004 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:18.926121 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:18.927179 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:18.927184 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:18.927753 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:18.927976 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.927990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.929361 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.929366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.930801 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:18.930823 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.931888 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.931895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:18.932134 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.932916 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:18.932942 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:18.936275 (+ 3333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:18.941509 (+ 5234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.941516 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.941520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.942228 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.942822 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:18.942827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:18.942831 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:18.943024 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:18.943934 (+ 910us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:18.943940 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:18.944119 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 19:31:18.944309 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 19:31:18.944682 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260806 19:31:18.946341 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:18.925520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58426 (local address 127.17.18.124:33081)
0806 19:31:18.925837 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:18.925842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:18.926734 (+ 892us) server_negotiation.cc:407] Connection header received
0806 19:31:18.926796 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:18.926801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:18.926884 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:18.926978 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:18.928165 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.929213 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.931056 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:18.931696 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:18.931827 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:18.936548 (+ 4721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:18.936556 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:18.936562 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:18.936610 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:18.941227 (+ 4617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.942427 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.942435 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.942438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.942655 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:18.943188 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:18.943195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:18.943199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:18.943674 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:18.943860 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:18.945664 (+ 1804us) server_negotiation.cc:299] Negotiation successful
0806 19:31:18.945960 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:31:18.938813 5057 master_runner.cc:186] Error getting master registration for 127.17.18.125:40047: OK, instance_id { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" instance_seqno: 1786044678193916 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:31:18.950501 5057 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 19:31:18.954917 5043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: Bootstrap starting.
I20260806 19:31:18.960331 5043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:18.963165 5043 log.cc:824] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:18.967393 5043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: No bootstrap required, opened a new log
W20260806 19:31:18.968552 5209 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:31:18.968797 5209 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:31:18.980856 5043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.981935 5043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:18.982149 5043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8427c54f2147c38779d2e4942433e2, State: Initialized, Role: FOLLOWER
I20260806 19:31:18.988155 5043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:18.989771 5213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:18.990392 5213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:18.991467 5043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:31:18.995290 5087 tablet.cc:2369] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:19.016852 4947 master_runner.cc:263] No leader master found from master 1e8427c54f2147c38779d2e4942433e2
I20260806 19:31:19.017064 4947 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 19:31:19.024683 5233 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:31:19.024997 5233 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:31:19.029318 5164 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:19.029707 5164 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:19.031508 5164 leader_election.cc:288] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e8427c54f2147c38779d2e4942433e2 (127.17.18.125:40047), 9c6b33c6919049838a77020d4c13ebd9 (127.17.18.124:33081)
I20260806 19:31:19.032980 5008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae2106b127914c5facd0ea07777c8b7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8427c54f2147c38779d2e4942433e2" is_pre_election: true
I20260806 19:31:19.033883 5008 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae2106b127914c5facd0ea07777c8b7e in term 0.
I20260806 19:31:19.033874 5117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae2106b127914c5facd0ea07777c8b7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c6b33c6919049838a77020d4c13ebd9" is_pre_election: true
I20260806 19:31:19.034499 5117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae2106b127914c5facd0ea07777c8b7e in term 0.
I20260806 19:31:19.034935 4865 leader_election.cc:302] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8427c54f2147c38779d2e4942433e2, ae2106b127914c5facd0ea07777c8b7e; no voters:
I20260806 19:31:19.035576 5164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:31:19.035763 5164 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:31:19.035892 5164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:19.039628 5164 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:19.041338 5008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae2106b127914c5facd0ea07777c8b7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8427c54f2147c38779d2e4942433e2"
I20260806 19:31:19.041651 5008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:19.045938 5008 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae2106b127914c5facd0ea07777c8b7e in term 1.
I20260806 19:31:19.046787 4865 leader_election.cc:302] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8427c54f2147c38779d2e4942433e2, ae2106b127914c5facd0ea07777c8b7e; no voters:
I20260806 19:31:19.048282 5117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae2106b127914c5facd0ea07777c8b7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c6b33c6919049838a77020d4c13ebd9"
I20260806 19:31:19.048604 5117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:19.052201 5164 leader_election.cc:288] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [CANDIDATE]: Term 1 election: Requested vote from peers 1e8427c54f2147c38779d2e4942433e2 (127.17.18.125:40047), 9c6b33c6919049838a77020d4c13ebd9 (127.17.18.124:33081)
I20260806 19:31:19.052527 5117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae2106b127914c5facd0ea07777c8b7e in term 1.
I20260806 19:31:19.052615 5164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:19.052790 5164 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [term 1 LEADER]: Becoming Leader. State: Replica: ae2106b127914c5facd0ea07777c8b7e, State: Running, Role: LEADER
I20260806 19:31:19.053490 5164 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } }
I20260806 19:31:19.062130 5235 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae2106b127914c5facd0ea07777c8b7e. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.062847 5235 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:19.074105 5241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:19.076627 5241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:19.093430 5117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [term 1 FOLLOWER]: Refusing update from remote peer ae2106b127914c5facd0ea07777c8b7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:19.094743 5235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:19.106659 5008 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [term 1 FOLLOWER]: Refusing update from remote peer ae2106b127914c5facd0ea07777c8b7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:19.107981 5235 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:19.133837 5213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae2106b127914c5facd0ea07777c8b7e. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.134260 5213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:19.147365 5235 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.147699 5235 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:19.148407 5190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae2106b127914c5facd0ea07777c8b7e. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.148748 5190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:19.150454 5241 catalog_manager.cc:1347] Generated new cluster ID: 820a20ce33144ce9a8acfb79e838fa41
I20260806 19:31:19.150575 5241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:19.154206 5213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.154533 5213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:19.164455 5164 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.164866 5164 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:19.180864 5190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ae2106b127914c5facd0ea07777c8b7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae2106b127914c5facd0ea07777c8b7e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45619 } } peers { permanent_uuid: "1e8427c54f2147c38779d2e4942433e2" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 40047 } } peers { permanent_uuid: "9c6b33c6919049838a77020d4c13ebd9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 33081 } } }
I20260806 19:31:19.181192 5190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:31:19.195416 5241 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:31:19.202559 5241 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:19.231137 5241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae2106b127914c5facd0ea07777c8b7e: Generated new TSK 0
I20260806 19:31:19.235697 5241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:31:19.970988 5209 catalog_manager.cc:1259] Loaded cluster ID: 820a20ce33144ce9a8acfb79e838fa41
I20260806 19:31:19.971103 5209 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: loading cluster ID for follower catalog manager: success
I20260806 19:31:19.973719 5209 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: acquiring CA information for follower catalog manager: success
I20260806 19:31:19.975641 5209 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c6b33c6919049838a77020d4c13ebd9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:31:20.027491 5233 catalog_manager.cc:1259] Loaded cluster ID: 820a20ce33144ce9a8acfb79e838fa41
I20260806 19:31:20.027614 5233 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: loading cluster ID for follower catalog manager: success
I20260806 19:31:20.030673 5233 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: acquiring CA information for follower catalog manager: success
I20260806 19:31:20.032776 5233 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e8427c54f2147c38779d2e4942433e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:31:20.404313 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 4836
I20260806 19:31:20.405869 4930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:20.526402 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 4836
I20260806 19:31:20.562819 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 4947
I20260806 19:31:20.564008 5037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:20.675602 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 4947
I20260806 19:31:20.707072 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5057
I20260806 19:31:20.708357 5149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:20.821666 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5057
2026-08-06T19:31:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5236 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:31:20 dist-test-slave-f0tn krb5kdc[5270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:31:20 dist-test-slave-f0tn krb5kdc[5270](info): set up 2 sockets
Aug 06 19:31:20 dist-test-slave-f0tn krb5kdc[5270](info): commencing operation
krb5kdc: starting...
W20260806 19:31:22.090210 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:31:22 dist-test-slave-f0tn krb5kdc[5270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:31:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:31:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:31:22.429888 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42753
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:42753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:22.798373 5289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:22.798754 5289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:22.798909 5289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:22.806561 5289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:22.806739 5289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:22.806830 5289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:22.806912 5289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:22.806977 5289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:22.817415 5289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:42753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:22.818921 5289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:22.820291 5289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:22.833117 5297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:22.833063 5300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:22.833092 5298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:22.834144 5289 server_base.cc:1034] running on GCE node
I20260806 19:31:22.834988 5289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:22.836607 5289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:22.837827 5289 hybrid_clock.cc:648] HybridClock initialized: now 1786044682837768 us; error 53 us; skew 500 ppm
I20260806 19:31:22.838187 5289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:22 dist-test-slave-f0tn krb5kdc[5270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044682, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:22.848235 5289 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:22.850121 5289 webserver.cc:460] Webserver started at http://127.17.18.126:40463/ using document root <none> and password file <none>
I20260806 19:31:22.850906 5289 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:22.851044 5289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:22.851384 5289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:22.854689 5289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "f9cea8b2a8ea4a2892df074fd5384b89"
format_stamp: "Formatted at 2026-08-06 19:31:22 on dist-test-slave-f0tn"
server_key: "0cd27ac8b6d06fe073cb3ba544994f1c"
server_key_iv: "fc09ac7bb953dc1a248a38e4a9c43592"
server_key_version: "encryptionkey@0"
I20260806 19:31:22.855504 5289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "f9cea8b2a8ea4a2892df074fd5384b89"
format_stamp: "Formatted at 2026-08-06 19:31:22 on dist-test-slave-f0tn"
server_key: "0cd27ac8b6d06fe073cb3ba544994f1c"
server_key_iv: "fc09ac7bb953dc1a248a38e4a9c43592"
server_key_version: "encryptionkey@0"
I20260806 19:31:22.861598 5289 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 19:31:22.865639 5310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:22.867146 5289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:31:22.867384 5289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "f9cea8b2a8ea4a2892df074fd5384b89"
format_stamp: "Formatted at 2026-08-06 19:31:22 on dist-test-slave-f0tn"
server_key: "0cd27ac8b6d06fe073cb3ba544994f1c"
server_key_iv: "fc09ac7bb953dc1a248a38e4a9c43592"
server_key_version: "encryptionkey@0"
I20260806 19:31:22.867609 5289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:22.898380 5289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:22.903352 5289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:22.903664 5289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:22.924188 5289 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:42753
I20260806 19:31:22.924206 5378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:42753 every 8 connection(s)
I20260806 19:31:22.925765 5289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:22.930169 5379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:22.932873 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5289
I20260806 19:31:22.933109 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:31:22.933858 17481 external_mini_cluster.cc:1428] Setting key 26f850e29cfa45ca59e1118f6eb36536
I20260806 19:31:22.944212 5379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89: Bootstrap starting.
I20260806 19:31:22.948328 5379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:22.949523 5379 log.cc:824] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:31:22 dist-test-slave-f0tn krb5kdc[5270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:22.953157 5379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89: No bootstrap required, opened a new log
I20260806 19:31:22.962873 5384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:22.936066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.17.18.126:42753)
0806 19:31:22.936986 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:22.937003 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:22.937061 (+ 58us) server_negotiation.cc:407] Connection header received
0806 19:31:22.939649 (+ 2588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:22.939685 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:22.940293 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:22.940812 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:22.942466 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:22.944481 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:22.946062 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:22.947344 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:22.947566 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:22.952410 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:22.952423 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:22.952451 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:22.952503 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:22.957008 (+ 4505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:22.958116 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:22.958129 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:22.958140 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:22.958382 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:22.958879 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:22.958885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:22.958888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:22.959779 (+ 891us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:22.960122 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:22.960655 (+ 533us) server_negotiation.cc:299] Negotiation successful
0806 19:31:22.961221 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":401,"threads_started":1}
I20260806 19:31:22.964267 5379 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } }
I20260806 19:31:22.964669 5379 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:22.964792 5379 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9cea8b2a8ea4a2892df074fd5384b89, State: Initialized, Role: FOLLOWER
I20260806 19:31:22.965447 5379 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } }
I20260806 19:31:22.965739 5379 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:22.965890 5379 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:22.966058 5379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:22.967417 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:31:22.968598 5379 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } }
I20260806 19:31:22.969135 5379 leader_election.cc:302] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9cea8b2a8ea4a2892df074fd5384b89; no voters:
I20260806 19:31:22.969828 5379 leader_election.cc:288] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:31:22.969987 5386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:22.970654 5386 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [term 1 LEADER]: Becoming Leader. State: Replica: f9cea8b2a8ea4a2892df074fd5384b89, State: Running, Role: LEADER
I20260806 19:31:22.971369 5386 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } }
I20260806 19:31:22.972767 5379 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:22.974733 5387 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9cea8b2a8ea4a2892df074fd5384b89. Latest consensus state: current_term: 1 leader_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } } }
I20260806 19:31:22.974705 5389 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9cea8b2a8ea4a2892df074fd5384b89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42753 } } }
I20260806 19:31:22.975194 5389 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:22.975201 5387 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:22.976512 5396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:22.982513 5396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:22.992795 5396 catalog_manager.cc:1347] Generated new cluster ID: 9fe74b9e70a24c2a96f718de2dc48c56
I20260806 19:31:22.992936 5396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:23.050494 5396 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:31:23.051972 5396 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:23.064548 5396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9cea8b2a8ea4a2892df074fd5384b89: Generated new TSK 0
I20260806 19:31:23.065894 5396 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:31:23.080657 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5289
I20260806 19:31:23.082389 5374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:23.185886 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5289
2026-08-06T19:31:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2358 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:31:23 dist-test-slave-f0tn krb5kdc[5429](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:31:23 dist-test-slave-f0tn krb5kdc[5429](info): set up 2 sockets
Aug 06 19:31:23 dist-test-slave-f0tn krb5kdc[5429](info): commencing operation
krb5kdc: starting...
W20260806 19:31:24.427773 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:31:24 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:31:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:31:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:31:24.756892 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:25.140298 5447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:25.140655 5447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:25.140774 5447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:25.149269 5447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:25.149458 5447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:25.149549 5447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:25.149633 5447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:25.149699 5447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:25.161077 5447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:25.163046 5447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:25.164659 5447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:25.178539 5454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:25.178637 5453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:25.178637 5456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:25.179564 5447 server_base.cc:1034] running on GCE node
I20260806 19:31:25.180567 5447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:25.182492 5447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:25.183781 5447 hybrid_clock.cc:648] HybridClock initialized: now 1786044685183719 us; error 45 us; skew 500 ppm
I20260806 19:31:25.184262 5447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:25 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:25.188336 5447 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:25.190341 5447 webserver.cc:460] Webserver started at http://127.17.18.126:37049/ using document root <none> and password file <none>
I20260806 19:31:25.191121 5447 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:25.191277 5447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:25.191617 5447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:25.195194 5447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "07e9474142a94fb28a8184ef5af45965"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "23b590d33a0107e5cfc557bff9740f78"
server_key_iv: "a7e4c67dbb8ca2fd36e484dfbf24459d"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.196159 5447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "07e9474142a94fb28a8184ef5af45965"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "23b590d33a0107e5cfc557bff9740f78"
server_key_iv: "a7e4c67dbb8ca2fd36e484dfbf24459d"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.202654 5447 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 19:31:25.206885 5463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:25.208503 5447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260806 19:31:25.208716 5447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "07e9474142a94fb28a8184ef5af45965"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "23b590d33a0107e5cfc557bff9740f78"
server_key_iv: "a7e4c67dbb8ca2fd36e484dfbf24459d"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.208942 5447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:25.233551 5447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:25.239017 5447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:25.239387 5447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:25.260075 5447 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43143
I20260806 19:31:25.260113 5541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43143 every 8 connection(s)
I20260806 19:31:25.261703 5447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:25.266227 5542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:25.271283 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5447
I20260806 19:31:25.271538 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:31:25.272372 17481 external_mini_cluster.cc:1428] Setting key 099fbaf9102b2dcfe5ef7d95d35e2552
I20260806 19:31:25.280208 5542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap starting.
I20260806 19:31:25.284389 5542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:25.285977 5542 log.cc:824] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:31:25 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:25.289934 5542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: No bootstrap required, opened a new log
I20260806 19:31:25.298290 5542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:25.298733 5542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:25.298838 5542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Initialized, Role: FOLLOWER
I20260806 19:31:25.299225 5545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:25.274885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36828 (local address 127.17.18.126:43143)
0806 19:31:25.275810 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:25.275824 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:25.275872 (+ 48us) server_negotiation.cc:407] Connection header received
0806 19:31:25.278385 (+ 2513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:25.278420 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:25.278918 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:25.279308 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:25.281272 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.282899 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.284837 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.285711 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.285933 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:25.290918 (+ 4985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:25.290928 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:25.290948 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:25.290996 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:25.294382 (+ 3386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:25.295253 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:25.295263 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:25.295271 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:25.295471 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:25.295923 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:25.295927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:25.295929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:25.296656 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:25.296990 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:25.297513 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 19:31:25.298007 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":441,"threads_started":1}
I20260806 19:31:25.299489 5542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:25.299798 5542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:25.299958 5542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:25.300149 5542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:25.303056 5542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:25.303570 5542 leader_election.cc:302] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e9474142a94fb28a8184ef5af45965; no voters:
I20260806 19:31:25.304229 5542 leader_election.cc:288] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:31:25.304392 5548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:25.305614 5548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 LEADER]: Becoming Leader. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Running, Role: LEADER
I20260806 19:31:25.306193 5548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:25.306634 5542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:25.309269 5549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:25.309353 5551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e9474142a94fb28a8184ef5af45965. Latest consensus state: current_term: 1 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:25.309749 5549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:25.309810 5551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:25.313339 5559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:25.319048 5559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:25.330276 5559 catalog_manager.cc:1347] Generated new cluster ID: 54e89758808243f89814b80987738268
I20260806 19:31:25.330420 5559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:25.355896 5559 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:31:25.357477 5559 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:25.365763 5559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Generated new TSK 0
I20260806 19:31:25.366742 5559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:31:25.441604 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:25.821218 5574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:25.821606 5574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:25.821779 5574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:25.829669 5574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:25.829805 5574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:25.829968 5574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:25.840440 5574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:25.842006 5574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:25.843504 5574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:25.857971 5580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:25.858022 5579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:25.857995 5582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:25.863265 5574 server_base.cc:1034] running on GCE node
I20260806 19:31:25.864030 5574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:25.865306 5574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:25.866650 5574 hybrid_clock.cc:648] HybridClock initialized: now 1786044685866546 us; error 62 us; skew 500 ppm
I20260806 19:31:25.867031 5574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:25 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:25.870669 5574 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:25.872468 5574 webserver.cc:460] Webserver started at http://127.17.18.65:41317/ using document root <none> and password file <none>
I20260806 19:31:25.873289 5574 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:25.873476 5574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:25.873806 5574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:25.877084 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "01428b0d3a2e4707aa1b684d2539dcac"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "537ea3b14a2a8a4e9bd6b082a3292f1a"
server_key_iv: "712d9724f665d84a3104dc2527ee7f98"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.878068 5574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "01428b0d3a2e4707aa1b684d2539dcac"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "537ea3b14a2a8a4e9bd6b082a3292f1a"
server_key_iv: "712d9724f665d84a3104dc2527ee7f98"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.884166 5574 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 19:31:25.888075 5593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:25.889658 5574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:31:25.889838 5574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "01428b0d3a2e4707aa1b684d2539dcac"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "537ea3b14a2a8a4e9bd6b082a3292f1a"
server_key_iv: "712d9724f665d84a3104dc2527ee7f98"
server_key_version: "encryptionkey@0"
I20260806 19:31:25.890050 5574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:25.910173 5574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:25.914933 5574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:25.915256 5574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:25.916424 5574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:25.918064 5574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:25.918144 5574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:25.918282 5574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:25.918334 5574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:25.952760 5574 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42413
I20260806 19:31:25.952813 5751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42413 every 8 connection(s)
I20260806 19:31:25.954155 5574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:25.955298 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5574
I20260806 19:31:25.955521 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:31:25.956382 17481 external_mini_cluster.cc:1428] Setting key 7954899b6000a064b1fc9aa889030530
Aug 06 19:31:25 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044685, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:25.977464 5754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:25.957313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:45421 (local address 127.17.18.126:43143)
0806 19:31:25.957876 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:25.957882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:25.959066 (+ 1184us) server_negotiation.cc:407] Connection header received
0806 19:31:25.961058 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:25.961063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:25.961156 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:25.961255 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:25.963114 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.963882 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.965779 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.966204 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.966338 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:25.970383 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:25.970389 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:25.970393 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:25.970435 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:25.973756 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:25.974716 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:25.974722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:25.974725 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:25.974891 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:25.975396 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:25.975402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:25.975405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:25.975787 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:25.975935 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:25.976804 (+ 869us) server_negotiation.cc:299] Negotiation successful
0806 19:31:25.977069 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":256,"threads_started":1}
I20260806 19:31:25.978359 5755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:25.957983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:45421)
0806 19:31:25.958893 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:25.958938 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:25.960729 (+ 1791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:25.961578 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:25.961588 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:25.962249 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:25.962897 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:25.962917 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.964075 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.964079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:25.965592 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:25.965607 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:25.966470 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:25.966479 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:25.966730 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:25.967437 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:25.967468 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:25.970050 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:25.973975 (+ 3925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:25.973985 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:25.974003 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:25.974537 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:25.974992 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:25.974995 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:25.974998 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:25.975242 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:25.975933 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:25.975941 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:25.976361 (+ 420us) client_negotiation.cc:769] Sending connection context
0806 19:31:25.976613 (+ 252us) client_negotiation.cc:240] Negotiation successful
0806 19:31:25.977077 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":323,"threads_started":1}
I20260806 19:31:25.980165 5752 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:25.980559 5752 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:25.981642 5752 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:25.984289 5488 ts_manager.cc:194] Registered new tserver with Master: 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65:42413)
I20260806 19:31:25.986019 5488 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:45421
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:31:26.034145 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:26.414127 5759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:26.414472 5759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:26.414628 5759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:26.422415 5759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:26.422572 5759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:26.422730 5759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:26.433573 5759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:26.435158 5759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:26.436766 5759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:26.451092 5771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:26.451110 5765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:26.451349 5766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:26.452426 5759 server_base.cc:1034] running on GCE node
I20260806 19:31:26.453284 5759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:26.454427 5759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:26.455646 5759 hybrid_clock.cc:648] HybridClock initialized: now 1786044686455601 us; error 38 us; skew 500 ppm
I20260806 19:31:26.456001 5759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:26 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044686, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:26.459450 5759 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:26.461103 5759 webserver.cc:460] Webserver started at http://127.17.18.66:35805/ using document root <none> and password file <none>
I20260806 19:31:26.461907 5759 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:26.462024 5759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:26.462309 5759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:26.465552 5759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "6255407488f44f23879d2d2262435a02"
format_stamp: "Formatted at 2026-08-06 19:31:26 on dist-test-slave-f0tn"
server_key: "dc3540765d6f22ad3c64a0267e9a95a7"
server_key_iv: "989d2c8f9b42484aa6a784f01fac1388"
server_key_version: "encryptionkey@0"
I20260806 19:31:26.466395 5759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "6255407488f44f23879d2d2262435a02"
format_stamp: "Formatted at 2026-08-06 19:31:26 on dist-test-slave-f0tn"
server_key: "dc3540765d6f22ad3c64a0267e9a95a7"
server_key_iv: "989d2c8f9b42484aa6a784f01fac1388"
server_key_version: "encryptionkey@0"
I20260806 19:31:26.471988 5759 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:31:26.475776 5782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:26.477186 5759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:31:26.477356 5759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "6255407488f44f23879d2d2262435a02"
format_stamp: "Formatted at 2026-08-06 19:31:26 on dist-test-slave-f0tn"
server_key: "dc3540765d6f22ad3c64a0267e9a95a7"
server_key_iv: "989d2c8f9b42484aa6a784f01fac1388"
server_key_version: "encryptionkey@0"
I20260806 19:31:26.477607 5759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:26.496080 5759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:26.500582 5759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:26.500885 5759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:26.502027 5759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:26.503518 5759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:26.503613 5759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:26.503750 5759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:26.503805 5759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:26.539842 5759 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45185
I20260806 19:31:26.539880 5947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45185 every 8 connection(s)
I20260806 19:31:26.541240 5759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:31:26.548581 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5759
I20260806 19:31:26.548786 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:31:26.549283 17481 external_mini_cluster.cc:1428] Setting key f61f6a5c77450887164e8a0c54b0bf8d
Aug 06 19:31:26 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044686, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:26.562894 5951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:26.543947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:44819 (local address 127.17.18.126:43143)
0806 19:31:26.544405 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:26.544411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:26.545558 (+ 1147us) server_negotiation.cc:407] Connection header received
0806 19:31:26.547596 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:26.547602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:26.547696 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:26.547811 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:26.549724 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:26.550467 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:26.552204 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:26.552649 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:26.552777 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:26.556746 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:26.556752 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:26.556755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:26.556793 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:26.559411 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:26.560265 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:26.560270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:26.560273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:26.560430 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:26.560935 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:26.560940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:26.560942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:26.561236 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:26.561398 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:26.562223 (+ 825us) server_negotiation.cc:299] Negotiation successful
0806 19:31:26.562500 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":222,"threads_started":1}
I20260806 19:31:26.563921 5952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:26.544537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:44819)
0806 19:31:26.545336 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:26.545423 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:26.547262 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:26.548104 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:26.548138 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:26.548737 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:26.549509 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:26.549533 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:26.550661 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:26.550665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:26.552033 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:26.552049 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:26.552929 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:26.552938 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:26.553187 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:26.553951 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:26.553978 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:26.556447 (+ 2469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:26.559593 (+ 3146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:26.559605 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:26.559623 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:26.560111 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:26.560553 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:26.560559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:26.560563 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:26.560806 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:26.561374 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:26.561403 (+ 29us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:26.561814 (+ 411us) client_negotiation.cc:769] Sending connection context
0806 19:31:26.562086 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 19:31:26.562703 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":304,"threads_started":1}
I20260806 19:31:26.565536 5948 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:26.565886 5948 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:26.566720 5948 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:26.568375 5488 ts_manager.cc:194] Registered new tserver with Master: 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185)
I20260806 19:31:26.569514 5488 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:44819
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:31:26.622015 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:26.990293 5752 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
W20260806 19:31:26.990682 5955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:26.991091 5955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:26.991257 5955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:26.999397 5955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:26.999549 5955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:26.999727 5955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:27.010480 5955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:27.011993 5955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:27.013523 5955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:27.027707 5967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:27.027787 5962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:27.027753 5965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:27.028522 5955 server_base.cc:1034] running on GCE node
I20260806 19:31:27.029253 5955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:27.030381 5955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:27.031598 5955 hybrid_clock.cc:648] HybridClock initialized: now 1786044687031542 us; error 43 us; skew 500 ppm
I20260806 19:31:27.031957 5955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:27 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044687, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:27.035584 5955 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:27.037176 5955 webserver.cc:460] Webserver started at http://127.17.18.67:46551/ using document root <none> and password file <none>
I20260806 19:31:27.037979 5955 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:27.038105 5955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:27.038432 5955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:27.041743 5955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "14ee4710dc1e4be99a201115008e5d53"
format_stamp: "Formatted at 2026-08-06 19:31:27 on dist-test-slave-f0tn"
server_key: "f9dc8db14c6edcdbd9b0fd5220135a5f"
server_key_iv: "d0a75a913203cddcb37ef40c24db28b3"
server_key_version: "encryptionkey@0"
I20260806 19:31:27.042572 5955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "14ee4710dc1e4be99a201115008e5d53"
format_stamp: "Formatted at 2026-08-06 19:31:27 on dist-test-slave-f0tn"
server_key: "f9dc8db14c6edcdbd9b0fd5220135a5f"
server_key_iv: "d0a75a913203cddcb37ef40c24db28b3"
server_key_version: "encryptionkey@0"
I20260806 19:31:27.048326 5955 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:31:27.052273 5981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:27.053864 5955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:27.054054 5955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "14ee4710dc1e4be99a201115008e5d53"
format_stamp: "Formatted at 2026-08-06 19:31:27 on dist-test-slave-f0tn"
server_key: "f9dc8db14c6edcdbd9b0fd5220135a5f"
server_key_iv: "d0a75a913203cddcb37ef40c24db28b3"
server_key_version: "encryptionkey@0"
I20260806 19:31:27.054340 5955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:27.070667 5955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:27.075160 5955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:27.075438 5955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:27.076444 5955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:27.078066 5955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:27.078169 5955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:27.078307 5955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:27.078389 5955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:27.114074 5955 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43607
I20260806 19:31:27.114151 6137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43607 every 8 connection(s)
I20260806 19:31:27.115437 5955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:27.115751 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 5955
I20260806 19:31:27.115912 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:31:27.116513 17481 external_mini_cluster.cc:1428] Setting key d3f6a79b6644f6f1f39ad7780a397075
Aug 06 19:31:27 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044687, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:27.138784 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.118481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:38043 (local address 127.17.18.126:43143)
0806 19:31:27.119002 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.119010 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.120285 (+ 1275us) server_negotiation.cc:407] Connection header received
0806 19:31:27.122423 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.122428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.122505 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.122628 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:27.124313 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.125161 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.126978 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.127399 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.127503 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.131381 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:27.131386 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:27.131390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:27.131429 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:27.135315 (+ 3886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.136273 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.136278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.136281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.136434 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.136916 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.136920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.136922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.137280 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:27.137483 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.138269 (+ 786us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.138477 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":251,"threads_started":1}
I20260806 19:31:27.139873 6145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.119152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:38043)
0806 19:31:27.120092 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.120147 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.122088 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.122853 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.122863 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.123451 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:27.124104 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.124123 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.125362 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.125366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.126785 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.126799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.127612 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.127618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.127844 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.128508 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:27.128534 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:27.131119 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:27.135496 (+ 4377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:27.135505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:27.135523 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:27.136086 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:27.136530 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:27.136533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:27.136535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:27.136780 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:27.137430 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:27.137440 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:27.137860 (+ 420us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.138115 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.138588 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":334,"threads_started":1}
I20260806 19:31:27.141680 6138 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:27.142041 6138 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:27.142911 6138 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:27.144802 5488 ts_manager.cc:194] Registered new tserver with Master: 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
I20260806 19:31:27.145856 5488 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:38043
I20260806 19:31:27.146647 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:31:27.166586 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.151726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36842 (local address 127.17.18.126:43143)
0806 19:31:27.151960 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.151967 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.152348 (+ 381us) server_negotiation.cc:407] Connection header received
0806 19:31:27.152540 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.152544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.152619 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.152716 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:27.154367 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.155189 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.156582 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.157011 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.157146 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.160370 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:27.160376 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:27.160379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:27.160427 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:27.163463 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.164327 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.164332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.164334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.164480 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.164918 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.164923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.164925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.165310 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:27.165606 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.165974 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.166241 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:31:27.176507 5488 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:31:27.184165 5488 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:31:27.220808 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.198223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48176 (local address 127.17.18.67:43607)
0806 19:31:27.210939 (+ 12716us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.210950 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.210997 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:31:27.211428 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.211440 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.211786 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.212090 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:27.213037 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.214835 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.217874 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.219480 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.219629 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.219901 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.220275 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.220467 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12431,"thread_start_us":12925,"threads_started":1}
I20260806 19:31:27.220839 6162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.197954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43607 (local address 127.0.0.1:48176)
0806 19:31:27.206043 (+ 8089us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.206107 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.206355 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.212154 (+ 5799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.212164 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.212214 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:27.212735 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.212753 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.215037 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.215043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.217656 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.217676 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.219718 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.219729 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.219975 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.220056 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.220192 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.220410 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7717,"mutex_wait_us":4,"thread_start_us":15464,"threads_started":1}
I20260806 19:31:27.223441 6167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.207546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45185 (local address 127.0.0.1:44134)
0806 19:31:27.214174 (+ 6628us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.214196 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.214322 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.215302 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.215307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.215336 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:27.215786 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.215799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.217788 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.217793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.220130 (+ 2337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.220145 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.222447 (+ 2302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.222455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.222653 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.222689 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.222803 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.222954 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6502,"mutex_wait_us":65,"thread_start_us":6352,"threads_started":1}
I20260806 19:31:27.223649 6164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.199010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46754 (local address 127.17.18.65:42413)
0806 19:31:27.215115 (+ 16105us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.215124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.215155 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:31:27.215266 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.215272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.215499 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.215705 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:27.216419 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.217837 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.220023 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.222555 (+ 2532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.222711 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.222943 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.223150 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.223326 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15913,"thread_start_us":15747,"threads_started":1}
I20260806 19:31:27.224211 6165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.207532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44134 (local address 127.17.18.66:45185)
0806 19:31:27.214586 (+ 7054us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.214597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.214633 (+ 36us) server_negotiation.cc:407] Connection header received
0806 19:31:27.214753 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.214763 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.215075 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.215319 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:27.216032 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.217614 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.220351 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.222201 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.222371 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.222578 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.223728 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.223919 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6847,"thread_start_us":6723,"threads_started":1}
I20260806 19:31:27.223922 6159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.198373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46754)
0806 19:31:27.212852 (+ 14479us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.212872 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.212995 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.215722 (+ 2727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.215727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.215757 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:27.216226 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.216237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.218015 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.218019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.219856 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.219877 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.222777 (+ 2900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.222784 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.222960 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.222994 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.223090 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.223237 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14332,"thread_start_us":7663,"threads_started":1}
I20260806 19:31:27.225677 6045 tablet_service.cc:1467] Processing CreateTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 (DEFAULT_TABLE table=test-table [id=d74f3f1422e4415e94c2c97221c700ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:27.227864 6045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296b119444c4deb887ac2e37fe7fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:27.228474 5659 tablet_service.cc:1467] Processing CreateTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 (DEFAULT_TABLE table=test-table [id=d74f3f1422e4415e94c2c97221c700ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:27.228474 5856 tablet_service.cc:1467] Processing CreateTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 (DEFAULT_TABLE table=test-table [id=d74f3f1422e4415e94c2c97221c700ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:27.230072 5659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296b119444c4deb887ac2e37fe7fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:27.230087 5856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8296b119444c4deb887ac2e37fe7fd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:27.241597 6168 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Bootstrap starting.
I20260806 19:31:27.245283 6168 tablet_bootstrap.cc:654] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:27.246310 6169 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Bootstrap starting.
I20260806 19:31:27.246891 6168 log.cc:824] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:27.247267 6170 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Bootstrap starting.
I20260806 19:31:27.250823 6168 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: No bootstrap required, opened a new log
I20260806 19:31:27.251137 6168 ts_tablet_manager.cc:1397] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 19:31:27.251381 6170 tablet_bootstrap.cc:654] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:27.251582 6169 tablet_bootstrap.cc:654] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:27.252826 6169 log.cc:824] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:27.252828 6170 log.cc:824] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:27.256281 6170 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: No bootstrap required, opened a new log
I20260806 19:31:27.256446 6169 tablet_bootstrap.cc:492] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: No bootstrap required, opened a new log
I20260806 19:31:27.256611 6170 ts_tablet_manager.cc:1397] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260806 19:31:27.256747 6169 ts_tablet_manager.cc:1397] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260806 19:31:27.265128 6170 raft_consensus.cc:348] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.265887 6170 raft_consensus.cc:374] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:27.266058 6170 raft_consensus.cc:729] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6255407488f44f23879d2d2262435a02, State: Initialized, Role: FOLLOWER
I20260806 19:31:27.267045 6170 consensus_queue.cc:260] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.267835 6169 raft_consensus.cc:348] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.267787 6168 raft_consensus.cc:348] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.268348 6168 raft_consensus.cc:374] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:27.268388 6169 raft_consensus.cc:374] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:27.268491 6169 raft_consensus.cc:729] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01428b0d3a2e4707aa1b684d2539dcac, State: Initialized, Role: FOLLOWER
I20260806 19:31:27.268518 6168 raft_consensus.cc:729] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee4710dc1e4be99a201115008e5d53, State: Initialized, Role: FOLLOWER
I20260806 19:31:27.269418 6169 consensus_queue.cc:260] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.269450 6168 consensus_queue.cc:260] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.276458 6170 ts_tablet_manager.cc:1428] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Time spent starting tablet: real 0.020s user 0.011s sys 0.007s
I20260806 19:31:27.277105 5948 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
I20260806 19:31:27.277742 6169 ts_tablet_manager.cc:1428] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Time spent starting tablet: real 0.021s user 0.014s sys 0.009s
I20260806 19:31:27.282214 6138 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
I20260806 19:31:27.284243 6168 ts_tablet_manager.cc:1428] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Time spent starting tablet: real 0.033s user 0.008s sys 0.016s
W20260806 19:31:27.293329 5949 tablet.cc:2369] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:31:27.367481 6139 tablet.cc:2369] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:27.421227 6176 raft_consensus.cc:482] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:27.421577 6176 raft_consensus.cc:504] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.423441 6176 leader_election.cc:288] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607), 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185)
I20260806 19:31:27.430807 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.423940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:36227 (local address 127.17.18.67:43607)
0806 19:31:27.424165 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.424172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.425039 (+ 867us) server_negotiation.cc:407] Connection header received
0806 19:31:27.425230 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.425234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.425296 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.425395 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:27.426052 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.426790 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.428860 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.429757 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.429933 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.430012 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.430404 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.430537 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:31:27.430825 6165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.424172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:38191 (local address 127.17.18.66:45185)
0806 19:31:27.424401 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.424408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.425066 (+ 658us) server_negotiation.cc:407] Connection header received
0806 19:31:27.425234 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.425238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.425298 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.425412 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:27.426108 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.426801 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.428861 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.429760 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.429917 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.430001 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.430404 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.430545 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 19:31:27.431001 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.423925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43607 (local address 127.17.18.65:36227)
0806 19:31:27.424891 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.424909 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.425080 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.425432 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.425436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.425462 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:27.425892 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.425905 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.426923 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.426928 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.428689 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.428702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.430050 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.430057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.430223 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.430273 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.430353 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.430537 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":169,"thread_start_us":553,"threads_started":1}
I20260806 19:31:27.431133 6178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.423956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45185 (local address 127.17.18.65:38191)
0806 19:31:27.424949 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:27.424964 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:27.425102 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:27.425437 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:27.425442 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:27.425584 (+ 142us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:27.425929 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.425939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.426934 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.426938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.428687 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:27.428701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.429995 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.430001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:27.430179 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.430269 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 19:31:27.430355 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 19:31:27.430528 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":106,"spinlock_wait_cycles":46080,"thread_start_us":638,"threads_started":1}
I20260806 19:31:27.432469 6074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296b119444c4deb887ac2e37fe7fd77" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4710dc1e4be99a201115008e5d53" is_pre_election: true
I20260806 19:31:27.432469 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296b119444c4deb887ac2e37fe7fd77" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6255407488f44f23879d2d2262435a02" is_pre_election: true
I20260806 19:31:27.433136 5884 raft_consensus.cc:2454] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 0.
I20260806 19:31:27.433127 6074 raft_consensus.cc:2454] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 0.
I20260806 19:31:27.434100 5599 leader_election.cc:302] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac, 14ee4710dc1e4be99a201115008e5d53; no voters:
I20260806 19:31:27.434612 6176 raft_consensus.cc:2781] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:31:27.434772 6176 raft_consensus.cc:482] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:31:27.434891 6176 raft_consensus.cc:3037] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:27.437301 6176 raft_consensus.cc:504] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.438019 6176 leader_election.cc:288] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 election: Requested vote from peers 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607), 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185)
I20260806 19:31:27.438751 6074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296b119444c4deb887ac2e37fe7fd77" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4710dc1e4be99a201115008e5d53"
I20260806 19:31:27.438769 5884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8296b119444c4deb887ac2e37fe7fd77" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6255407488f44f23879d2d2262435a02"
I20260806 19:31:27.439013 6074 raft_consensus.cc:3037] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:27.439011 5884 raft_consensus.cc:3037] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:27.442476 6074 raft_consensus.cc:2454] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 1.
I20260806 19:31:27.442476 5884 raft_consensus.cc:2454] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 1.
I20260806 19:31:27.443146 5599 leader_election.cc:302] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac, 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02; no voters:
I20260806 19:31:27.443543 6176 raft_consensus.cc:2781] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:27.444049 6176 raft_consensus.cc:686] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 1 LEADER]: Becoming Leader. State: Replica: 01428b0d3a2e4707aa1b684d2539dcac, State: Running, Role: LEADER
I20260806 19:31:27.444619 6176 consensus_queue.cc:237] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } }
I20260806 19:31:27.449728 5486 catalog_manager.cc:5495] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac reported cstate change: term changed from 0 to 1, leader changed from <none> to 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65). New cstate: current_term: 1 leader_uuid: "01428b0d3a2e4707aa1b684d2539dcac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } health_report { overall_health: UNKNOWN } } }
W20260806 19:31:27.457243 5753 tablet.cc:2369] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:27.520251 6164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.514627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46764 (local address 127.17.18.65:42413)
0806 19:31:27.514838 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.514844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.514865 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:31:27.515078 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.515082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.515165 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.515336 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:31:27.515733 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.516476 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.517942 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.518368 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.518483 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.519087 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:31:27.519648 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:31:27.519800 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.519880 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.519973 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 19:31:27.529163 5884 raft_consensus.cc:1261] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Refusing update from remote peer 01428b0d3a2e4707aa1b684d2539dcac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:27.529161 6074 raft_consensus.cc:1261] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Refusing update from remote peer 01428b0d3a2e4707aa1b684d2539dcac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:27.530299 6181 consensus_queue.cc:1035] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:27.530702 6176 consensus_queue.cc:1035] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:27.573753 5487 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:27.574092 5487 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:27.578475 5487 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Sending DeleteTablet for 3 replicas of tablet 8296b119444c4deb887ac2e37fe7fd77
I20260806 19:31:27.579974 6045 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:27 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48176
I20260806 19:31:27.579979 5856 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:27 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:44134
I20260806 19:31:27.580684 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5574
I20260806 19:31:27.580828 5659 tablet_service.cc:1514] Processing DeleteTablet for tablet 8296b119444c4deb887ac2e37fe7fd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:27 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:46754
I20260806 19:31:27.591836 6202 tablet_replica.cc:330] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: stopping tablet replica
I20260806 19:31:27.593070 6204 tablet_replica.cc:330] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: stopping tablet replica
I20260806 19:31:27.593811 6204 raft_consensus.cc:2229] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:31:27.594080 6202 raft_consensus.cc:2229] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:27.594812 6204 raft_consensus.cc:2258] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:27.595353 6202 raft_consensus.cc:2258] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:27.596037 6203 tablet_replica.cc:330] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: stopping tablet replica
I20260806 19:31:27.596534 6203 raft_consensus.cc:2229] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:27.597126 6203 raft_consensus.cc:2258] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:27.597926 6204 ts_tablet_manager.cc:1905] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:27.599421 6203 ts_tablet_manager.cc:1905] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:27.602099 6202 ts_tablet_manager.cc:1905] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:27.606458 6204 ts_tablet_manager.cc:1918] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:27.606760 6204 log.cc:1196] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/8296b119444c4deb887ac2e37fe7fd77
I20260806 19:31:27.607275 6203 ts_tablet_manager.cc:1918] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:27.607518 6203 log.cc:1196] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/8296b119444c4deb887ac2e37fe7fd77
I20260806 19:31:27.607523 6204 ts_tablet_manager.cc:1939] T 8296b119444c4deb887ac2e37fe7fd77 P 01428b0d3a2e4707aa1b684d2539dcac: Deleting consensus metadata
I20260806 19:31:27.608222 6203 ts_tablet_manager.cc:1939] T 8296b119444c4deb887ac2e37fe7fd77 P 6255407488f44f23879d2d2262435a02: Deleting consensus metadata
I20260806 19:31:27.609879 5464 catalog_manager.cc:4841] TS 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65:42413): tablet 8296b119444c4deb887ac2e37fe7fd77 (table test-table [id=d74f3f1422e4415e94c2c97221c700ac]) successfully deleted
I20260806 19:31:27.610291 5464 catalog_manager.cc:4841] TS 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): tablet 8296b119444c4deb887ac2e37fe7fd77 (table test-table [id=d74f3f1422e4415e94c2c97221c700ac]) successfully deleted
Aug 06 19:31:27 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:31:27.613869 6202 ts_tablet_manager.cc:1918] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:27.614158 6202 log.cc:1196] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/8296b119444c4deb887ac2e37fe7fd77
I20260806 19:31:27.614784 6202 ts_tablet_manager.cc:1939] T 8296b119444c4deb887ac2e37fe7fd77 P 14ee4710dc1e4be99a201115008e5d53: Deleting consensus metadata
I20260806 19:31:27.616545 5468 catalog_manager.cc:4841] TS 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): tablet 8296b119444c4deb887ac2e37fe7fd77 (table test-table [id=d74f3f1422e4415e94c2c97221c700ac]) successfully deleted
I20260806 19:31:27.622071 6164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.581819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46772 (local address 127.17.18.65:42413)
0806 19:31:27.582033 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.582040 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.592720 (+ 10680us) server_negotiation.cc:407] Connection header received
0806 19:31:27.593073 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.593080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.593205 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.593301 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:27.598261 (+ 4960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.599557 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.607699 (+ 8142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.608384 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.608516 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.615067 (+ 6551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:27.615093 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:27.615117 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:27.615178 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:27.618931 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.619777 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.619785 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.619788 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.619948 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.620365 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.620369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.620371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.620761 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:27.621074 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.621461 (+ 387us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.621742 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:31:27.622978 5746 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:27.727655 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5574
I20260806 19:31:27.754705 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5759
Aug 06 19:31:27 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:31:27.770372 6165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.755536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.17.18.66:45185)
0806 19:31:27.755709 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.755714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.755733 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:31:27.755933 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.755938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.756029 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.756119 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:27.757473 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.758308 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.759800 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.760212 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.760312 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.764739 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:27.764758 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:27.764778 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:27.764821 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:27.767644 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.768433 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.768442 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.768444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.768582 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.768894 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.768897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.768899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.769335 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:27.769625 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.769866 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.770064 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:31:27.771132 5943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:27.864864 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5759
I20260806 19:31:27.897159 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5955
Aug 06 19:31:27 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:31:27.918108 6161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:27.898065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48184 (local address 127.17.18.67:43607)
0806 19:31:27.898274 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:27.898279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:27.898299 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:27.898396 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:27.898400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:27.898478 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:27.898564 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:27.899921 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.900688 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.902415 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:27.902853 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:27.902965 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:27.911888 (+ 8923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:27.911944 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:27.911970 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:27.912019 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:27.915109 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.916015 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.916024 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.916027 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.916210 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:27.916570 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:27.916574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:27.916576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:27.916983 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:27.917246 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:27.917570 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 19:31:27.917776 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:31:27.918784 6133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:28.010651 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5955
I20260806 19:31:28.037887 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 5447
I20260806 19:31:28.039295 5536 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:28.155987 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 5447
I20260806 19:31:28.187263 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--webserver_interface=127.17.18.126
--webserver_port=37049
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:28.559016 6212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:28.559383 6212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:28.559531 6212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:28.567477 6212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:28.567615 6212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:28.567692 6212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:28.567795 6212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:28.567853 6212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:28.578555 6212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=37049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:28.580029 6212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:28.581607 6212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:28.609189 6230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:28.609097 6226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:28.609130 6227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:28.610085 6212 server_base.cc:1034] running on GCE node
I20260806 19:31:28.611102 6212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:28.612950 6212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:28.614205 6212 hybrid_clock.cc:648] HybridClock initialized: now 1786044688614152 us; error 51 us; skew 500 ppm
I20260806 19:31:28.614653 6212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:28 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044688, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:28.618636 6212 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:28.620740 6212 webserver.cc:460] Webserver started at http://127.17.18.126:37049/ using document root <none> and password file <none>
I20260806 19:31:28.621672 6212 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:28.621855 6212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:28.629460 6212 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.003s
I20260806 19:31:28.633091 6238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:28.634932 6212 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 19:31:28.635245 6212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "07e9474142a94fb28a8184ef5af45965"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "23b590d33a0107e5cfc557bff9740f78"
server_key_iv: "a7e4c67dbb8ca2fd36e484dfbf24459d"
server_key_version: "encryptionkey@0"
I20260806 19:31:28.636499 6212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:28.657125 6212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:28.662454 6212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:28.662765 6212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:28.683494 6212 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43143
I20260806 19:31:28.683545 6319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43143 every 8 connection(s)
I20260806 19:31:28.685217 6212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:28.690268 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 6212
I20260806 19:31:28.691331 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:42413
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=41317
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:28.694684 6321 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:31:28.699824 6321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap starting.
I20260806 19:31:28.722796 6321 log.cc:824] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:28.736867 6321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:31:28.737540 6321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap complete.
I20260806 19:31:28.747948 6321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:28.749099 6321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Initialized, Role: FOLLOWER
I20260806 19:31:28.749919 6321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:28.750182 6321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:28.750334 6321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:28.750501 6321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 1 FOLLOWER]: Advancing to term 2
I20260806 19:31:28.755316 6321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:28.756067 6321 leader_election.cc:302] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e9474142a94fb28a8184ef5af45965; no voters:
I20260806 19:31:28.756788 6321 leader_election.cc:288] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 19:31:28.756958 6325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 19:31:28.758296 6325 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 LEADER]: Becoming Leader. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Running, Role: LEADER
I20260806 19:31:28.759080 6325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:28.759578 6321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:28.762079 6328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e9474142a94fb28a8184ef5af45965. Latest consensus state: current_term: 2 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:28.762557 6328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:28.762567 6327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:28.763217 6327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:28.775022 6337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:28.784468 6337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:28.786320 6337 catalog_manager.cc:1259] Loaded cluster ID: 54e89758808243f89814b80987738268
I20260806 19:31:28.786532 6337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:28.790697 6337 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 19:31:28.812392 6337 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 19:31:28.822922 6337 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:28.824911 6337 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Loaded TSK: 0
I20260806 19:31:28.826792 6337 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:31:29.095528 6323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:29.095866 6323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:29.096012 6323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:29.103672 6323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:29.103837 6323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:29.103998 6323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:29.115234 6323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:42413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=41317
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:29.116701 6323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:29.118278 6323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:29.134227 6363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:29.134290 6366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:29.134956 6362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:29.135768 6323 server_base.cc:1034] running on GCE node
I20260806 19:31:29.136504 6323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:29.137625 6323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:29.138866 6323 hybrid_clock.cc:648] HybridClock initialized: now 1786044689138801 us; error 55 us; skew 500 ppm
I20260806 19:31:29.139269 6323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:29 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044689, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:29.143580 6323 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:29.145437 6323 webserver.cc:460] Webserver started at http://127.17.18.65:41317/ using document root <none> and password file <none>
I20260806 19:31:29.146242 6323 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:29.146405 6323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:29.152905 6323 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 19:31:29.156278 6378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.158036 6323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:29.158252 6323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "01428b0d3a2e4707aa1b684d2539dcac"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "537ea3b14a2a8a4e9bd6b082a3292f1a"
server_key_iv: "712d9724f665d84a3104dc2527ee7f98"
server_key_version: "encryptionkey@0"
I20260806 19:31:29.159350 6323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:29.183305 6323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:29.188190 6323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:29.188490 6323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:29.189669 6323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:29.191339 6323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:29.191438 6323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.191555 6323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:29.191630 6323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.226042 6323 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42413
I20260806 19:31:29.226145 6550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42413 every 8 connection(s)
I20260806 19:31:29.227618 6323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:29.228152 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 6323
I20260806 19:31:29.228914 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:45185
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=35805
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:29 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044689, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:29.255172 6556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:29.231262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:37287)
0806 19:31:29.232233 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:29.232297 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:29.234206 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:29.236037 (+ 1831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:29.236046 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:29.236639 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:29.237222 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:29.237242 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.239615 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.239620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:29.241092 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:29.241108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.242393 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.242402 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:29.242698 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:29.243382 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:29.243413 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:29.245970 (+ 2557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:29.250610 (+ 4640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:29.250618 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:29.250633 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:29.251138 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:29.251666 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:29.251669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:29.251672 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:29.251876 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:29.252894 (+ 1018us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:29.252900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:29.253250 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 19:31:29.253542 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 19:31:29.253986 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":376,"threads_started":1}
I20260806 19:31:29.255481 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:29.231061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:37287 (local address 127.17.18.126:43143)
0806 19:31:29.231739 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:29.231756 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:29.232458 (+ 702us) server_negotiation.cc:407] Connection header received
0806 19:31:29.234900 (+ 2442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:29.234922 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:29.235457 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:29.235899 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:29.237532 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.239360 (+ 1828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.241266 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.242106 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.242314 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:29.246331 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:29.246342 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:29.246365 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:29.246424 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:29.250414 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:29.251310 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:29.251320 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:29.251328 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:29.251556 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:29.251984 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:29.251989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:29.251992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:29.252761 (+ 769us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:29.252945 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:29.253777 (+ 832us) server_negotiation.cc:299] Negotiation successful
0806 19:31:29.254260 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":271,"threads_started":1}
I20260806 19:31:29.258504 6553 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:29.258837 6553 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:29.259685 6553 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:29.262617 6263 ts_manager.cc:194] Registered new tserver with Master: 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65:42413)
I20260806 19:31:29.264750 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:37287
W20260806 19:31:29.602890 6558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:29.603214 6558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:29.603344 6558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:29.611040 6558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:29.611187 6558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:29.611341 6558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:29.621693 6558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:45185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=35805
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:29.623185 6558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:29.624599 6558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:29.638411 6566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:29.638384 6567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:29.638464 6569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:29.639405 6558 server_base.cc:1034] running on GCE node
I20260806 19:31:29.640058 6558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:29.641062 6558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:29.642292 6558 hybrid_clock.cc:648] HybridClock initialized: now 1786044689642213 us; error 82 us; skew 500 ppm
I20260806 19:31:29.642621 6558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:29 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044689, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:29.645819 6558 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:29.647428 6558 webserver.cc:460] Webserver started at http://127.17.18.66:35805/ using document root <none> and password file <none>
I20260806 19:31:29.648208 6558 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:29.648353 6558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:29.654496 6558 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:31:29.657497 6580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.658934 6558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 19:31:29.659101 6558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "6255407488f44f23879d2d2262435a02"
format_stamp: "Formatted at 2026-08-06 19:31:26 on dist-test-slave-f0tn"
server_key: "dc3540765d6f22ad3c64a0267e9a95a7"
server_key_iv: "989d2c8f9b42484aa6a784f01fac1388"
server_key_version: "encryptionkey@0"
I20260806 19:31:29.660264 6558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:29.676255 6558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:29.680603 6558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:29.680891 6558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:29.681957 6558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:29.683483 6558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:29.683586 6558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.683707 6558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:29.683779 6558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:29.718370 6558 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45185
I20260806 19:31:29.718428 6756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45185 every 8 connection(s)
I20260806 19:31:29.720007 6558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:31:29.724615 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 6558
I20260806 19:31:29.725235 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:43607
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=46551
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:31:29 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044689, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:29.744443 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:29.724130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:48385 (local address 127.17.18.126:43143)
0806 19:31:29.724394 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:29.724401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:29.725777 (+ 1376us) server_negotiation.cc:407] Connection header received
0806 19:31:29.727735 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:29.727741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:29.727844 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:29.727937 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:29.729718 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.730437 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.732172 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.732638 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.732757 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:29.736525 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:29.736531 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:29.736535 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:29.736575 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:29.739619 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:29.740723 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:29.740728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:29.740731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:29.740906 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:29.741594 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:29.741598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:29.741601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:29.742008 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:29.742395 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:29.743910 (+ 1515us) server_negotiation.cc:299] Negotiation successful
0806 19:31:29.744163 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 19:31:29.745911 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:29.724635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:48385)
0806 19:31:29.725562 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:29.725619 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:29.727416 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:29.728229 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:29.728238 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:29.728821 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:29.729519 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:29.729544 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.730605 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.730609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:29.731990 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:29.732005 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:29.732892 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:29.732899 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:29.733137 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:29.733877 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:29.733904 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:29.736268 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:29.739825 (+ 3557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:29.739836 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:29.739858 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:29.740545 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:29.741037 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:29.741043 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:29.741047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:29.741410 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:29.742444 (+ 1034us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:29.742469 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:29.743378 (+ 909us) client_negotiation.cc:769] Sending connection context
0806 19:31:29.743729 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 19:31:29.744386 (+ 657us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":368,"threads_started":1}
I20260806 19:31:29.747725 6757 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:29.748104 6757 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:29.748916 6757 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:29.750681 6263 ts_manager.cc:194] Registered new tserver with Master: 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185)
I20260806 19:31:29.751812 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:48385
W20260806 19:31:30.089491 6762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:30.089823 6762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:30.089926 6762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:30.097445 6762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:30.097579 6762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:30.097736 6762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:30.108137 6762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:43607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=46551
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:30.109728 6762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:30.111091 6762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:30.125505 6770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:30.125526 6769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:30.125463 6774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:30.126391 6762 server_base.cc:1034] running on GCE node
I20260806 19:31:30.127075 6762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:30.128158 6762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:30.129639 6762 hybrid_clock.cc:648] HybridClock initialized: now 1786044690129382 us; error 72 us; skew 500 ppm
I20260806 19:31:30.130052 6762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:30 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044690, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:30.133781 6762 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:30.135885 6762 webserver.cc:460] Webserver started at http://127.17.18.67:46551/ using document root <none> and password file <none>
I20260806 19:31:30.136762 6762 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:30.136931 6762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:30.143676 6762 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 19:31:30.147343 6788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:30.149179 6762 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 19:31:30.149425 6762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "14ee4710dc1e4be99a201115008e5d53"
format_stamp: "Formatted at 2026-08-06 19:31:27 on dist-test-slave-f0tn"
server_key: "f9dc8db14c6edcdbd9b0fd5220135a5f"
server_key_iv: "d0a75a913203cddcb37ef40c24db28b3"
server_key_version: "encryptionkey@0"
I20260806 19:31:30.150528 6762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:30.178244 6762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:30.182716 6762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:30.183004 6762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:30.184116 6762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:30.185612 6762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:30.185714 6762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:30.185827 6762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:30.185899 6762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:30.218515 6762 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43607
I20260806 19:31:30.218582 6950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43607 every 8 connection(s)
I20260806 19:31:30.220109 6762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:30.223229 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 6762
Aug 06 19:31:30 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044690, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:30.247551 6555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.223076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:43661 (local address 127.17.18.126:43143)
0806 19:31:30.223288 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.223293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.225135 (+ 1842us) server_negotiation.cc:407] Connection header received
0806 19:31:30.228536 (+ 3401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.228545 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.228660 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.228743 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:30.231808 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.233182 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.236171 (+ 2989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.236713 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.236837 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.241005 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:30.241010 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:30.241014 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:30.241065 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:30.243924 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.244813 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.244817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.244819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.244977 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.245495 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.245525 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.245529 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.245917 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:30.246078 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.246910 (+ 832us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.247178 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 19:31:30.248701 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.223861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:43661)
0806 19:31:30.224903 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.224965 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.228064 (+ 3099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.229494 (+ 1430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.229510 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.230470 (+ 960us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:30.231494 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.231527 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.233989 (+ 2462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.233996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.235963 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.235983 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.236986 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.236994 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.237268 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.238044 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:30.238071 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:30.240751 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:30.244128 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:30.244140 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:30.244157 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:30.244677 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:30.245101 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:30.245105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:30.245108 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:30.245326 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:30.246053 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:30.246063 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:30.246466 (+ 403us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.246745 (+ 279us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.247364 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":384,"threads_started":1}
I20260806 19:31:30.250063 6961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.224411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36854 (local address 127.17.18.126:43143)
0806 19:31:30.235044 (+ 10633us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.235052 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.235486 (+ 434us) server_negotiation.cc:407] Connection header received
0806 19:31:30.235685 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.235690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.235766 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.236253 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:30.238083 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.238860 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.240573 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.241093 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.241231 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.244162 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:30.244168 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:30.244172 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:30.244208 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:30.247112 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.247916 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.247922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.247925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.248053 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.248497 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.248509 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.248511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.248805 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:30.249065 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.249473 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.249724 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10483,"thread_start_us":10328,"threads_started":1}
I20260806 19:31:30.250306 6951 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43143
I20260806 19:31:30.250694 6951 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:30.251609 6951 heartbeater.cc:511] Master 127.17.18.126:43143 requested a full tablet report, sending...
I20260806 19:31:30.253101 6263 ts_manager.cc:194] Registered new tserver with Master: 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
I20260806 19:31:30.253993 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:43661
I20260806 19:31:30.265905 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:31:30.268535 6553 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
I20260806 19:31:30.273578 6961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.266865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36868 (local address 127.17.18.126:43143)
0806 19:31:30.267076 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.267081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.267575 (+ 494us) server_negotiation.cc:407] Connection header received
0806 19:31:30.267785 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.267789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.267952 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.268091 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:31:30.268594 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.269569 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.271314 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.271786 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.271889 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.272454 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:31:30.273006 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:31:30.273123 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.273201 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.273278 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:31:30.274710 6263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36868:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:31:30.283133 6263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:31:30.319130 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.296600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44158 (local address 127.17.18.66:45185)
0806 19:31:30.309355 (+ 12755us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.309368 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.309428 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:31:30.309570 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.309611 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.309953 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.310209 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:30.311126 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.312697 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.315681 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.317291 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.317456 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.317690 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.318456 (+ 766us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.318708 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12522,"thread_start_us":12776,"threads_started":1}
I20260806 19:31:30.320050 6970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.296427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45185 (local address 127.0.0.1:44158)
0806 19:31:30.307381 (+ 10954us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.307452 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.307739 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.310327 (+ 2588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.310337 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.310378 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:30.310906 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.310922 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.312895 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.312901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.315434 (+ 2533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.315452 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.317871 (+ 2419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.317879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.318112 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.318179 (+ 67us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.318355 (+ 176us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.319597 (+ 1242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10544,"thread_start_us":14176,"threads_started":1}
I20260806 19:31:30.320222 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.296854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.17.18.67:43607)
0806 19:31:30.310346 (+ 13492us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.310356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.311170 (+ 814us) server_negotiation.cc:407] Connection header received
0806 19:31:30.311346 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.311356 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.311626 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.311841 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:30.312815 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.314531 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.317063 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.318608 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.318754 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.319022 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.319642 (+ 620us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.319883 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13274,"thread_start_us":13089,"threads_started":1}
I20260806 19:31:30.320479 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.296727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43607 (local address 127.0.0.1:48196)
0806 19:31:30.311026 (+ 14299us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.311047 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.311191 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.312172 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.312178 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.312218 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:30.312586 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.312598 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.314722 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.314727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.316840 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.316859 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.319199 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.319215 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.319398 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.319431 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.319538 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.319660 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14146,"thread_start_us":11298,"threads_started":1}
I20260806 19:31:30.324762 6653 tablet_service.cc:1467] Processing CreateTablet for tablet e734f71153014584bce7e301926f06cf (DEFAULT_TABLE table=test-table [id=ae1378a2351d4cc5908d6083782bce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:30.324810 6856 tablet_service.cc:1467] Processing CreateTablet for tablet e734f71153014584bce7e301926f06cf (DEFAULT_TABLE table=test-table [id=ae1378a2351d4cc5908d6083782bce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:30.326340 6653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e734f71153014584bce7e301926f06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:30.326383 6856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e734f71153014584bce7e301926f06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:30.329885 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.311531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46774)
0806 19:31:30.320224 (+ 8693us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.320249 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.320500 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.321464 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.321469 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.321497 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:30.321809 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.321820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.324001 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.324006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.326103 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.326121 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.328970 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.328978 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.329170 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.329218 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.329311 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.329502 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8544,"thread_start_us":8360,"threads_started":1}
I20260806 19:31:30.330235 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.311625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46774 (local address 127.17.18.65:42413)
0806 19:31:30.318384 (+ 6759us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.318394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.320660 (+ 2266us) server_negotiation.cc:407] Connection header received
0806 19:31:30.320793 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.320802 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.321107 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.321342 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:30.322247 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.323824 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.326330 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.328204 (+ 1874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.328361 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.328609 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.329455 (+ 846us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.329653 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6538,"thread_start_us":6352,"threads_started":1}
I20260806 19:31:30.334803 6452 tablet_service.cc:1467] Processing CreateTablet for tablet e734f71153014584bce7e301926f06cf (DEFAULT_TABLE table=test-table [id=ae1378a2351d4cc5908d6083782bce96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:30.336544 6452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e734f71153014584bce7e301926f06cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:30.342648 6974 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Bootstrap starting.
I20260806 19:31:30.343228 6977 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Bootstrap starting.
I20260806 19:31:30.346938 6977 tablet_bootstrap.cc:654] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:30.346936 6974 tablet_bootstrap.cc:654] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:30.348440 6977 log.cc:824] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:30.349422 6974 log.cc:824] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:30.352082 6982 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Bootstrap starting.
I20260806 19:31:30.352332 6977 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: No bootstrap required, opened a new log
I20260806 19:31:30.352639 6977 ts_tablet_manager.cc:1397] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260806 19:31:30.355753 6982 tablet_bootstrap.cc:654] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:30.356973 6982 log.cc:824] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:30.357653 6974 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: No bootstrap required, opened a new log
I20260806 19:31:30.357975 6974 ts_tablet_manager.cc:1397] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.003s
I20260806 19:31:30.359932 6982 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: No bootstrap required, opened a new log
I20260806 19:31:30.360262 6982 ts_tablet_manager.cc:1397] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260806 19:31:30.363520 6977 raft_consensus.cc:348] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.364077 6977 raft_consensus.cc:374] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:30.364199 6977 raft_consensus.cc:729] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6255407488f44f23879d2d2262435a02, State: Initialized, Role: FOLLOWER
I20260806 19:31:30.365062 6977 consensus_queue.cc:260] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.366384 6757 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
I20260806 19:31:30.368644 6977 ts_tablet_manager.cc:1428] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260806 19:31:30.368894 6982 raft_consensus.cc:348] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.369369 6982 raft_consensus.cc:374] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:30.369494 6982 raft_consensus.cc:729] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01428b0d3a2e4707aa1b684d2539dcac, State: Initialized, Role: FOLLOWER
I20260806 19:31:30.369923 6974 raft_consensus.cc:348] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.370291 6974 raft_consensus.cc:374] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:30.370358 6974 raft_consensus.cc:729] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14ee4710dc1e4be99a201115008e5d53, State: Initialized, Role: FOLLOWER
I20260806 19:31:30.370206 6982 consensus_queue.cc:260] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.370908 6974 consensus_queue.cc:260] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.372259 6982 ts_tablet_manager.cc:1428] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260806 19:31:30.374183 6951 heartbeater.cc:503] Master 127.17.18.126:43143 was elected leader, sending a full tablet report...
I20260806 19:31:30.376065 6974 ts_tablet_manager.cc:1428] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Time spent starting tablet: real 0.018s user 0.014s sys 0.001s
I20260806 19:31:30.379509 6988 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:30.379798 6988 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.381613 6988 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
I20260806 19:31:30.388448 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.382147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:34071 (local address 127.17.18.66:45185)
0806 19:31:30.382359 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.382365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.383111 (+ 746us) server_negotiation.cc:407] Connection header received
0806 19:31:30.383302 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.383308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.383376 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.383450 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:30.384099 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.384839 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.386744 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.387528 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.387678 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.387757 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.388058 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.388196 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:31:30.388515 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.382251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:39279 (local address 127.17.18.67:43607)
0806 19:31:30.382554 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.382561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.383181 (+ 620us) server_negotiation.cc:407] Connection header received
0806 19:31:30.383342 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.383346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.383406 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.383480 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:30.384139 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.384879 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.386774 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.387606 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.387758 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.387834 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.388128 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.388260 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260806 19:31:30.388593 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.382016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45185 (local address 127.17.18.65:34071)
0806 19:31:30.382994 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.383011 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.383168 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.383482 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.383486 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.383520 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:30.383954 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.383966 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.384973 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.384978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.386586 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.386600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.387750 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.387756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.387906 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.387931 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.388015 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.388167 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":4,"thread_start_us":730,"threads_started":1}
I20260806 19:31:30.389249 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.382130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43607 (local address 127.17.18.65:39279)
0806 19:31:30.383073 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.383088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:30.383217 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:30.383510 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:30.383514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:30.383537 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:30.383962 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.383972 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.385026 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.385030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.386620 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:30.386633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.387837 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.387844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:30.387971 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.388004 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 19:31:30.388084 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 19:31:30.388232 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":4,"thread_start_us":437,"threads_started":1}
I20260806 19:31:30.389688 6682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e734f71153014584bce7e301926f06cf" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6255407488f44f23879d2d2262435a02" is_pre_election: true
I20260806 19:31:30.390304 6682 raft_consensus.cc:2454] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 0.
I20260806 19:31:30.390813 6893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e734f71153014584bce7e301926f06cf" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4710dc1e4be99a201115008e5d53" is_pre_election: true
I20260806 19:31:30.391041 6380 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac, 6255407488f44f23879d2d2262435a02; no voters:
I20260806 19:31:30.391304 6893 raft_consensus.cc:2454] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 0.
I20260806 19:31:30.391469 6988 raft_consensus.cc:2781] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:31:30.391611 6988 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:31:30.391711 6988 raft_consensus.cc:3037] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:30.394095 6988 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.394739 6988 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 election: Requested vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
I20260806 19:31:30.395267 6682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e734f71153014584bce7e301926f06cf" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6255407488f44f23879d2d2262435a02"
I20260806 19:31:30.395313 6893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e734f71153014584bce7e301926f06cf" candidate_uuid: "01428b0d3a2e4707aa1b684d2539dcac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14ee4710dc1e4be99a201115008e5d53"
I20260806 19:31:30.395466 6682 raft_consensus.cc:3037] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:30.395502 6893 raft_consensus.cc:3037] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:30.397840 6682 raft_consensus.cc:2454] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 1.
I20260806 19:31:30.397858 6893 raft_consensus.cc:2454] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01428b0d3a2e4707aa1b684d2539dcac in term 1.
I20260806 19:31:30.398298 6380 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac, 6255407488f44f23879d2d2262435a02; no voters:
I20260806 19:31:30.398617 6988 raft_consensus.cc:2781] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:30.399081 6988 raft_consensus.cc:686] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 LEADER]: Becoming Leader. State: Replica: 01428b0d3a2e4707aa1b684d2539dcac, State: Running, Role: LEADER
I20260806 19:31:30.399564 6988 consensus_queue.cc:237] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:30.404603 6261 catalog_manager.cc:5495] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac reported cstate change: term changed from 0 to 1, leader changed from <none> to 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65). New cstate: current_term: 1 leader_uuid: "01428b0d3a2e4707aa1b684d2539dcac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } health_report { overall_health: HEALTHY } } }
I20260806 19:31:30.439918 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.433780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46780 (local address 127.17.18.65:42413)
0806 19:31:30.434444 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.434448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.434465 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:31:30.434565 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.434569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.434664 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.434796 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:31:30.435247 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.436118 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.437706 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.438161 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.438262 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.438751 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:31:30.439335 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:31:30.439449 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.439557 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.439650 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523}
I20260806 19:31:30.448802 6682 raft_consensus.cc:1261] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Refusing update from remote peer 01428b0d3a2e4707aa1b684d2539dcac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:30.448802 6893 raft_consensus.cc:1261] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Refusing update from remote peer 01428b0d3a2e4707aa1b684d2539dcac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:30.449951 6997 consensus_queue.cc:1035] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Connected to new peer: Peer: permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:30.450337 6988 consensus_queue.cc:1035] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [LEADER]: Connected to new peer: Peer: permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:31:30.473495 6758 tablet.cc:2369] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:30.477195 6261 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:30.477581 6261 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36868:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:30.479640 7004 mvcc.cc:205] Tried to move back new op lower bound from 7315639052067397632 to 7315639051880620032. Current Snapshot: MvccSnapshot[applied={T|T < 7315639052067397632}]
I20260806 19:31:30.483088 6261 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Sending DeleteTablet for 3 replicas of tablet e734f71153014584bce7e301926f06cf
I20260806 19:31:30.484568 6653 tablet_service.cc:1514] Processing DeleteTablet for tablet e734f71153014584bce7e301926f06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:30 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:44158
I20260806 19:31:30.484867 6452 tablet_service.cc:1514] Processing DeleteTablet for tablet e734f71153014584bce7e301926f06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:30 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:46774
I20260806 19:31:30.485343 6856 tablet_service.cc:1514] Processing DeleteTablet for tablet e734f71153014584bce7e301926f06cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:30 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48196
I20260806 19:31:30.486740 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 6323
I20260806 19:31:30.494786 7013 tablet_replica.cc:330] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: stopping tablet replica
I20260806 19:31:30.495395 7013 raft_consensus.cc:2229] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:30.496016 7013 raft_consensus.cc:2258] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:30.496985 7016 tablet_replica.cc:330] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: stopping tablet replica
I20260806 19:31:30.497491 7016 raft_consensus.cc:2229] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:30.498050 7016 raft_consensus.cc:2258] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:30.500051 7016 ts_tablet_manager.cc:1905] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:30.501107 7013 ts_tablet_manager.cc:1905] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:30.506178 7014 tablet_replica.cc:330] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: stopping tablet replica
I20260806 19:31:30.506709 7014 raft_consensus.cc:2229] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:31:30.506960 7016 ts_tablet_manager.cc:1918] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:30.507187 7016 log.cc:1196] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/e734f71153014584bce7e301926f06cf
I20260806 19:31:30.507529 7014 raft_consensus.cc:2258] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:30.507809 7016 ts_tablet_manager.cc:1939] T e734f71153014584bce7e301926f06cf P 14ee4710dc1e4be99a201115008e5d53: Deleting consensus metadata
I20260806 19:31:30.510160 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.488986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46790 (local address 127.17.18.65:42413)
0806 19:31:30.489177 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.489183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.489205 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:31:30.489428 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.489434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.489537 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.489659 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:30.491835 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.493108 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.496350 (+ 3242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.497150 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.497301 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.501312 (+ 4011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:30.501333 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:30.501352 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:30.501439 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:30.505852 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.507014 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.507025 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.507028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.507436 (+ 408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.508203 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.508208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.508211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.508763 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:30.509075 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.509521 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.509802 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:31:30.510100 6243 catalog_manager.cc:4841] TS 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): tablet e734f71153014584bce7e301926f06cf (table test-table [id=ae1378a2351d4cc5908d6083782bce96]) successfully deleted
I20260806 19:31:30.511070 6545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:30.511608 7013 ts_tablet_manager.cc:1918] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:30.511792 7013 log.cc:1196] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/e734f71153014584bce7e301926f06cf
I20260806 19:31:30.512375 7013 ts_tablet_manager.cc:1939] T e734f71153014584bce7e301926f06cf P 6255407488f44f23879d2d2262435a02: Deleting consensus metadata
I20260806 19:31:30.516426 6239 catalog_manager.cc:4841] TS 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): tablet e734f71153014584bce7e301926f06cf (table test-table [id=ae1378a2351d4cc5908d6083782bce96]) successfully deleted
I20260806 19:31:30.511219 7014 ts_tablet_manager.cc:1905] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:30.634811 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 6323
W20260806 19:31:30.659979 6239 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.18.65:42413 (error 108)
I20260806 19:31:30.660153 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 6558
I20260806 19:31:30.662202 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.661693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46796)
0806 19:31:30.661930 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.662055 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260806 19:31:30.662488 6239 catalog_manager.cc:4584] TS 01428b0d3a2e4707aa1b684d2539dcac (127.17.18.65:42413): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e734f71153014584bce7e301926f06cf: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
I20260806 19:31:30.674592 6969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.661079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44174 (local address 127.17.18.66:45185)
0806 19:31:30.661298 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.661305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.661329 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:31:30.661587 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.661594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.661680 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.661799 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:30.663437 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.664280 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.665926 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.666337 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.666449 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.669213 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:30.669230 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:30.669248 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:30.669289 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:30.671991 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.672763 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.672771 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.672773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.672909 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.673194 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.673196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.673198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.673651 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:30.673890 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.674147 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.674329 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:31:30.675308 6750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:30.716243 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.715730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46808)
0806 19:31:30.715960 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.716072 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 19:31:30.717368 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.716967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46814)
0806 19:31:30.717136 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.717228 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 19:31:30.778052 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.777515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46828)
0806 19:31:30.777764 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.777858 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260806 19:31:30.779870 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.779379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46836)
0806 19:31:30.779621 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.779717 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260806 19:31:30.780479 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 6558
I20260806 19:31:30.810621 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 6762
I20260806 19:31:30.824990 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.811431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48212 (local address 127.17.18.67:43607)
0806 19:31:30.811640 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:30.811645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:30.811665 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:30.811904 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:30.811910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:30.811984 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:30.812109 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:30.813507 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.814286 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.815845 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:30.816287 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:30.816390 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:30.819233 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:30.819249 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:30.819268 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:30.819307 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:30.822170 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.822988 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.822998 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.823000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.823163 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:30.823511 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:30.823514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:30.823516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:30.823915 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:30.824146 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:30.824433 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 19:31:30.824632 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:31:30.825687 6946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:30.861035 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.860482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46838)
0806 19:31:30.860704 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.860822 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 19:31:30.862195 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:30.861752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46840)
0806 19:31:30.861960 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:30.862070 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 19:31:30.917707 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 6762
I20260806 19:31:30.944522 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 6212
I20260806 19:31:30.945843 6312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:31.064990 6972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:31.064388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42413 (local address 127.0.0.1:46854)
0806 19:31:31.064609 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:31.064744 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:42413: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 19:31:31.065249 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 6212
I20260806 19:31:31.099977 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--webserver_interface=127.17.18.126
--webserver_port=37049
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:31.489293 7027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:31.489702 7027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:31.489805 7027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:31.497576 7027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:31.497710 7027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:31.497757 7027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:31.497814 7027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:31.497860 7027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:31.508396 7027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=37049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:31.509804 7027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:31.511127 7027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:31.524266 7033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:31.524235 7037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:31.524164 7039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:31.525254 7027 server_base.cc:1034] running on GCE node
I20260806 19:31:31.526245 7027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:31.527927 7027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:31.529186 7027 hybrid_clock.cc:648] HybridClock initialized: now 1786044691529113 us; error 64 us; skew 500 ppm
I20260806 19:31:31.529640 7027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:31 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044691, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:31.533036 7027 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:31.534888 7027 webserver.cc:460] Webserver started at http://127.17.18.126:37049/ using document root <none> and password file <none>
I20260806 19:31:31.535686 7027 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:31.535826 7027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:31.542230 7027 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 19:31:31.545837 7049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:31.547610 7027 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260806 19:31:31.547860 7027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "07e9474142a94fb28a8184ef5af45965"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "23b590d33a0107e5cfc557bff9740f78"
server_key_iv: "a7e4c67dbb8ca2fd36e484dfbf24459d"
server_key_version: "encryptionkey@0"
I20260806 19:31:31.549094 7027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:31.567389 7027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:31.572721 7027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:31.573038 7027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:31.593561 7027 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43143
I20260806 19:31:31.593604 7118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43143 every 8 connection(s)
I20260806 19:31:31.595326 7027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:31.603392 7119 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:31:31.604209 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 7027
I20260806 19:31:31.605319 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:42413
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=41317
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:31.608814 7119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap starting.
I20260806 19:31:31.633839 7119 log.cc:824] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:31.654210 7119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:31:31.654812 7119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965: Bootstrap complete.
I20260806 19:31:31.664547 7119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:31.665606 7119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Initialized, Role: FOLLOWER
I20260806 19:31:31.666329 7119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:31.666569 7119 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:31.666700 7119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:31.666891 7119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 2 FOLLOWER]: Advancing to term 3
I20260806 19:31:31.671376 7119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:31.671983 7119 leader_election.cc:302] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07e9474142a94fb28a8184ef5af45965; no voters:
I20260806 19:31:31.672685 7119 leader_election.cc:288] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 19:31:31.672838 7125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 19:31:31.673956 7125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [term 3 LEADER]: Becoming Leader. State: Replica: 07e9474142a94fb28a8184ef5af45965, State: Running, Role: LEADER
I20260806 19:31:31.674571 7125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } }
I20260806 19:31:31.675068 7119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:31.677495 7129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07e9474142a94fb28a8184ef5af45965. Latest consensus state: current_term: 3 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:31.677927 7129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:31.677513 7126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "07e9474142a94fb28a8184ef5af45965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07e9474142a94fb28a8184ef5af45965" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43143 } } }
I20260806 19:31:31.678606 7126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07e9474142a94fb28a8184ef5af45965 [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:31.686184 7139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:31.695729 7139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:31.697460 7139 catalog_manager.cc:1259] Loaded cluster ID: 54e89758808243f89814b80987738268
I20260806 19:31:31.697604 7139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 19:31:31.700007 7139 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f80906ee9ad google::LogMessage::Fail() at ??:0
@ 0x7f80906f188a google::LogMessage::SendToLog() at ??:0
@ 0x7f80906ee4de google::LogMessage::Flush() at ??:0
@ 0x7f80906efa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f80a6121512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f80a611e976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f80a61a6610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f80a61a6439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f809333a345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f809333d91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f809333d799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f8093318eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f80965f26db start_thread at ??:0
@ 0x7f808f58861f clone at ??:0
W20260806 19:31:32.076692 7122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:32.077015 7122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:32.077131 7122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:32.084978 7122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:32.085127 7122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:32.085255 7122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:32.095726 7122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:42413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=41317
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:32.097108 7122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:32.098543 7122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:32.112703 7186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:32.112689 7182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:32.112767 7184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:32.113471 7122 server_base.cc:1034] running on GCE node
I20260806 19:31:32.114122 7122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:32.115222 7122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:32.116460 7122 hybrid_clock.cc:648] HybridClock initialized: now 1786044692116392 us; error 58 us; skew 500 ppm
I20260806 19:31:32.116797 7122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:32 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:32.120247 7122 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:32.122041 7122 webserver.cc:460] Webserver started at http://127.17.18.65:41317/ using document root <none> and password file <none>
I20260806 19:31:32.122798 7122 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:32.122937 7122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:32.129060 7122 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 19:31:32.132445 7195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:32.134209 7122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 19:31:32.134414 7122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "01428b0d3a2e4707aa1b684d2539dcac"
format_stamp: "Formatted at 2026-08-06 19:31:25 on dist-test-slave-f0tn"
server_key: "537ea3b14a2a8a4e9bd6b082a3292f1a"
server_key_iv: "712d9724f665d84a3104dc2527ee7f98"
server_key_version: "encryptionkey@0"
I20260806 19:31:32.135488 7122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:32.159708 7122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:32.165505 7122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:32.165843 7122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:32.167094 7122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:32.169857 7205 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260806 19:31:32.177328 7122 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 19:31:32.177567 7122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.000s sys 0.001s
I20260806 19:31:32.177717 7122 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 19:31:32.181680 7122 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 19:31:32.181818 7122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.003s sys 0.001s
I20260806 19:31:32.182374 7205 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Bootstrap starting.
I20260806 19:31:32.192498 7205 log.cc:824] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:32.210047 7205 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:31:32.211163 7205 tablet_bootstrap.cc:492] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Bootstrap complete.
I20260806 19:31:32.211939 7205 ts_tablet_manager.cc:1397] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Time spent bootstrapping tablet: real 0.030s user 0.027s sys 0.000s
I20260806 19:31:32.222956 7205 raft_consensus.cc:348] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:32.224208 7205 raft_consensus.cc:729] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01428b0d3a2e4707aa1b684d2539dcac, State: Initialized, Role: FOLLOWER
I20260806 19:31:32.225116 7205 consensus_queue.cc:260] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:32.225446 7122 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42413
I20260806 19:31:32.225483 7367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42413 every 8 connection(s)
I20260806 19:31:32.226936 7205 ts_tablet_manager.cc:1428] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260806 19:31:32.227023 7122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:32.228250 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 7122
I20260806 19:31:32.229027 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:45185
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=35805
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:32.232614 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.230362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:43535)
0806 19:31:32.231299 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.231606 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":378,"threads_started":1}
W20260806 19:31:32.233357 7369 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:43143 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:43143: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
I20260806 19:31:32.234380 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.234001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:54031)
0806 19:31:32.234175 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.234257 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 19:31:32.235361 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.234960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:42899)
0806 19:31:32.235126 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.235212 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 19:31:32.235633 7369 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:31:32.597731 7375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:32.598075 7375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:32.598208 7375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:32.606022 7375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:32.606160 7375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:32.606321 7375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:32.616773 7375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:45185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=35805
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:32.618177 7375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:32.619568 7375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:32.633774 7381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:32.633860 7383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:32.633790 7386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:32.634145 7375 server_base.cc:1034] running on GCE node
I20260806 19:31:32.635078 7375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:32.636065 7375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:32.637305 7375 hybrid_clock.cc:648] HybridClock initialized: now 1786044692637242 us; error 43 us; skew 500 ppm
I20260806 19:31:32.637703 7375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:32 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:32.641139 7375 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:32.642746 7375 webserver.cc:460] Webserver started at http://127.17.18.66:35805/ using document root <none> and password file <none>
I20260806 19:31:32.643489 7375 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:32.643617 7375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:32.649590 7375 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:31:32.652621 7395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:32.654171 7375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:32.654349 7375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "6255407488f44f23879d2d2262435a02"
format_stamp: "Formatted at 2026-08-06 19:31:26 on dist-test-slave-f0tn"
server_key: "dc3540765d6f22ad3c64a0267e9a95a7"
server_key_iv: "989d2c8f9b42484aa6a784f01fac1388"
server_key_version: "encryptionkey@0"
I20260806 19:31:32.655416 7375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:32.677256 7375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:32.682000 7375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:32.682305 7375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:32.683446 7375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:32.684976 7375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:32.685082 7375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:32.685204 7375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:32.685283 7375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:32.719210 7375 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:45185
I20260806 19:31:32.719308 7560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:45185 every 8 connection(s)
I20260806 19:31:32.720757 7375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:31:32.723006 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 7375
I20260806 19:31:32.723600 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:43607
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:43143
--webserver_port=46551
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:32.726428 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.723996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:43527)
0806 19:31:32.724903 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.725196 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":324,"threads_started":1}
W20260806 19:31:32.727231 7561 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:43143 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:43143: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
I20260806 19:31:32.728224 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.727829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:55101)
0806 19:31:32.727995 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.728089 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 19:31:32.729154 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:32.728785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:57197)
0806 19:31:32.728923 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:32.729023 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 19:31:32.729439 7561 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:31:33.089291 7566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:33.089695 7566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:33.089839 7566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:33.097680 7566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:33.097823 7566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:33.097973 7566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:33.108532 7566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:43607
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=46551
--tserver_master_addrs=127.17.18.126:43143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:33.110143 7566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:33.111953 7566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:33.127427 7576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:33.127385 7577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:33.127337 7581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:33.128154 7566 server_base.cc:1034] running on GCE node
I20260806 19:31:33.128925 7566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:33.130262 7566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:33.131516 7566 hybrid_clock.cc:648] HybridClock initialized: now 1786044693131456 us; error 48 us; skew 500 ppm
I20260806 19:31:33.131937 7566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:33 dist-test-slave-f0tn krb5kdc[5429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:33.139581 7566 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:33.141520 7566 webserver.cc:460] Webserver started at http://127.17.18.67:46551/ using document root <none> and password file <none>
I20260806 19:31:33.142349 7566 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:33.142481 7566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:33.148766 7566 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 19:31:33.152184 7597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:33.154531 7566 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 19:31:33.154757 7566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "14ee4710dc1e4be99a201115008e5d53"
format_stamp: "Formatted at 2026-08-06 19:31:27 on dist-test-slave-f0tn"
server_key: "f9dc8db14c6edcdbd9b0fd5220135a5f"
server_key_iv: "d0a75a913203cddcb37ef40c24db28b3"
server_key_version: "encryptionkey@0"
I20260806 19:31:33.156284 7566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:33.181143 7566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:33.186275 7566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:33.186554 7566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:33.187834 7566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:33.189548 7566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:33.189683 7566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:33.189777 7566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:33.189836 7566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:33.228093 7566 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43607
I20260806 19:31:33.228195 7754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43607 every 8 connection(s)
I20260806 19:31:33.229915 7566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:33.235458 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:33.233355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:55205)
0806 19:31:33.234266 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:33.234527 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":353,"threads_started":1}
W20260806 19:31:33.236277 7755 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:43143 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:43143: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
I20260806 19:31:33.237264 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:33.236864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:50447)
0806 19:31:33.237037 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:33.237130 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 19:31:33.237253 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:33.236311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:43593)
0806 19:31:33.236822 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:33.236967 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":222,"threads_started":1}
I20260806 19:31:33.237535 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 7566
I20260806 19:31:33.238729 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:33.238199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:44015)
0806 19:31:33.238423 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:33.238530 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 19:31:33.239169 7755 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 19:31:33.730875 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:33.730012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:39291)
0806 19:31:33.730512 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:33.730625 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":245,"threads_started":1}
I20260806 19:31:34.034076 7766 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:34.034408 7766 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:34.036053 7766 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
Aug 06 19:31:34 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
Aug 06 19:31:34 dist-test-slave-f0tn krb5kdc[5429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:31:34.076413 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.036435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:45185 (local address 127.17.18.65:36727)
0806 19:31:34.049901 (+ 13466us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:34.049928 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:34.050872 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:34.055048 (+ 4176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:34.055054 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:34.056014 (+ 960us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:34.057241 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:34.057276 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.059890 (+ 2614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.059897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:34.062494 (+ 2597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:34.062518 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.064189 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.064198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:34.064561 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:34.065596 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:34.065634 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:34.068343 (+ 2709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:34.072300 (+ 3957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:34.072309 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:34.072323 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:34.072971 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:34.073499 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:34.073504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:34.073508 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:34.073836 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:34.074760 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:34.074767 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:34.075072 (+ 305us) client_negotiation.cc:769] Sending connection context
0806 19:31:34.075325 (+ 253us) client_negotiation.cc:240] Negotiation successful
0806 19:31:34.075879 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13361,"mutex_wait_us":319,"spinlock_wait_cycles":26496,"thread_start_us":12626,"threads_started":1}
I20260806 19:31:34.076905 7770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.036973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:36727 (local address 127.17.18.66:45185)
0806 19:31:34.051703 (+ 14730us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:34.051718 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:34.051768 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:31:34.054097 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:34.054111 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:34.054568 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:34.055237 (+ 669us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:34.057587 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.059600 (+ 2013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.062710 (+ 3110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.063845 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.064086 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:34.068783 (+ 4697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:34.068795 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:34.068814 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:34.068869 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:34.072097 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:34.073151 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:34.073160 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:34.073165 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:34.073345 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:34.073971 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:34.073975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:34.073977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:34.074607 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:34.074772 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:34.075645 (+ 873us) server_negotiation.cc:299] Negotiation successful
0806 19:31:34.076080 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14529,"thread_start_us":14344,"threads_started":1}
I20260806 19:31:34.076526 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.036416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43607 (local address 127.17.18.65:51981)
0806 19:31:34.049879 (+ 13463us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:34.049929 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:34.050634 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:34.054844 (+ 4210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:34.054853 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:34.056014 (+ 1161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:34.057241 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:34.057276 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.059890 (+ 2614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.059897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:34.062494 (+ 2597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:34.062518 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.064154 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.064163 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:34.064565 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:34.065624 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:34.065672 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:34.068520 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:34.072300 (+ 3780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:34.072309 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:34.072324 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:34.072957 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:34.073563 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:34.073567 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:34.073570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:34.073836 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:34.075488 (+ 1652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:34.075493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:34.075667 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 19:31:34.075782 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 19:31:34.076099 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12829,"mutex_wait_us":219,"spinlock_wait_cycles":66048,"thread_start_us":13168,"threads_started":1}
I20260806 19:31:34.077204 7769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.036645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:51981 (local address 127.17.18.67:43607)
0806 19:31:34.051082 (+ 14437us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:34.051098 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:34.051140 (+ 42us) server_negotiation.cc:407] Connection header received
0806 19:31:34.053414 (+ 2274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:34.053434 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:34.054058 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:34.054484 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:34.057587 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.059625 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.062710 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:34.063845 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:34.064086 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:34.068857 (+ 4771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:34.068867 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:34.068881 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:34.068931 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:34.072089 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:34.073181 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:34.073189 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:34.073196 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:34.073430 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:34.074841 (+ 1411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:34.074845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:34.074847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:34.075326 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:34.075505 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:34.076086 (+ 581us) server_negotiation.cc:299] Negotiation successful
0806 19:31:34.076773 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14243,"thread_start_us":14122,"threads_started":1}
W20260806 19:31:34.080504 7201 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
W20260806 19:31:34.080922 7196 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
I20260806 19:31:34.081060 7196 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac; no voters: 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02
I20260806 19:31:34.081547 7766 raft_consensus.cc:2726] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 19:31:34.239108 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.238594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:39423)
0806 19:31:34.238821 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:34.238920 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260806 19:31:34.240669 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.239675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:49467)
0806 19:31:34.240197 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:34.240379 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":236,"threads_started":1}
I20260806 19:31:34.732833 7773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:34.731926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:55843)
0806 19:31:34.732555 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:34.732657 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":352,"threads_started":1}
I20260806 19:31:35.241781 7774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:35.240502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:39455)
0806 19:31:35.241285 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:35.241467 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":392,"threads_started":1}
I20260806 19:31:35.242776 7776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:35.241722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:41107)
0806 19:31:35.242348 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:35.242434 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":398,"threads_started":1}
I20260806 19:31:35.735170 7781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:35.733967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:51105)
0806 19:31:35.734840 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:35.734944 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":755,"thread_start_us":617,"threads_started":1}
I20260806 19:31:36.183357 7782 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:36.183578 7782 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:36.184238 7782 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
W20260806 19:31:36.185425 7201 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
W20260806 19:31:36.185614 7196 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
I20260806 19:31:36.185757 7196 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac; no voters: 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02
I20260806 19:31:36.186038 7782 raft_consensus.cc:2726] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 19:31:36.243892 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:36.242926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:53123)
0806 19:31:36.243481 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:36.243617 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":275,"threads_started":1}
I20260806 19:31:36.244771 7785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:36.243960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:44071)
0806 19:31:36.244515 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:36.244610 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":357,"threads_started":1}
I20260806 19:31:36.737015 7786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:36.736121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:44227)
0806 19:31:36.736713 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:36.736819 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":278,"threads_started":1}
I20260806 19:31:37.246102 7788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:37.245106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:48563)
0806 19:31:37.245770 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:37.245890 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":341,"threads_started":1}
I20260806 19:31:37.246434 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:37.245650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:58967)
0806 19:31:37.246133 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:37.246227 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":257,"threads_started":1}
I20260806 19:31:37.738898 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:37.738050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:45927)
0806 19:31:37.738614 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:37.738724 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":333,"threads_started":1}
I20260806 19:31:38.248032 7792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:38.247114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:56429)
0806 19:31:38.247696 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:38.247811 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":299,"threads_started":1}
I20260806 19:31:38.248486 7793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:38.247439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:37977)
0806 19:31:38.247995 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:38.248077 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":322,"threads_started":1}
I20260806 19:31:38.740819 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:38.739921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:45313)
0806 19:31:38.740476 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:38.740572 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":312,"threads_started":1}
I20260806 19:31:39.061007 7796 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:39.061245 7796 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:39.062021 7796 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
W20260806 19:31:39.063016 7201 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
W20260806 19:31:39.063239 7196 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
I20260806 19:31:39.063375 7196 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac; no voters: 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02
I20260806 19:31:39.063692 7796 raft_consensus.cc:2726] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 19:31:39.250180 7797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:39.249167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:36885)
0806 19:31:39.249822 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:39.249945 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":328,"threads_started":1}
I20260806 19:31:39.250180 7798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:39.249409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:56019)
0806 19:31:39.249911 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:39.249996 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":279,"threads_started":1}
I20260806 19:31:39.742753 7800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:39.741822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:40529)
0806 19:31:39.742427 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:39.742533 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":288,"threads_started":1}
I20260806 19:31:40.252154 7801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:40.251346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:36641)
0806 19:31:40.251889 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:40.251984 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":289,"threads_started":1}
I20260806 19:31:40.252977 7802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:40.251346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:60575)
0806 19:31:40.252709 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:40.252799 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1244,"thread_start_us":1075,"threads_started":1}
I20260806 19:31:40.744654 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:40.743848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:41061)
0806 19:31:40.744367 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:40.744464 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":266,"threads_started":1}
I20260806 19:31:41.254142 7806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:41.253298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:43947)
0806 19:31:41.253869 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:41.253958 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":285,"threads_started":1}
I20260806 19:31:41.254765 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:41.253928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:38255)
0806 19:31:41.254507 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:41.254586 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":226,"threads_started":1}
I20260806 19:31:41.556228 7812 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:41.556478 7812 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:41.557145 7812 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
W20260806 19:31:41.558231 7201 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
W20260806 19:31:41.558418 7196 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
I20260806 19:31:41.558562 7196 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac; no voters: 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02
I20260806 19:31:41.558815 7812 raft_consensus.cc:2726] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 19:31:41.746523 7814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:41.745661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:48551)
0806 19:31:41.746241 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:41.746339 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":272,"threads_started":1}
I20260806 19:31:42.256248 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:42.255369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:49369)
0806 19:31:42.255979 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:42.256074 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":303,"threads_started":1}
I20260806 19:31:42.256534 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:42.255684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:53483)
0806 19:31:42.256233 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:42.256348 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":292,"threads_started":1}
I20260806 19:31:42.748458 7817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:42.747522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:40473)
0806 19:31:42.748187 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:42.748275 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":355,"threads_started":1}
I20260806 19:31:43.258349 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:43.257467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:41631)
0806 19:31:43.258035 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:43.258142 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":292,"threads_started":1}
I20260806 19:31:43.258687 7820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:43.257548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:52889)
0806 19:31:43.258367 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:43.258459 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":615,"threads_started":1}
I20260806 19:31:43.750360 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:43.749552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:60567)
0806 19:31:43.750080 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:43.750182 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":237,"threads_started":1}
I20260806 19:31:44.226388 7823 raft_consensus.cc:482] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:44.226625 7823 raft_consensus.cc:504] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6255407488f44f23879d2d2262435a02" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 45185 } } peers { permanent_uuid: "14ee4710dc1e4be99a201115008e5d53" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43607 } } peers { permanent_uuid: "01428b0d3a2e4707aa1b684d2539dcac" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42413 } }
I20260806 19:31:44.227440 7823 leader_election.cc:288] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185), 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607)
W20260806 19:31:44.228498 7201 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 14ee4710dc1e4be99a201115008e5d53 (127.17.18.67:43607): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
W20260806 19:31:44.228801 7196 leader_election.cc:341] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6255407488f44f23879d2d2262435a02 (127.17.18.66:45185): Not found: Tablet not found: e734f71153014584bce7e301926f06cf
I20260806 19:31:44.228961 7196 leader_election.cc:302] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01428b0d3a2e4707aa1b684d2539dcac; no voters: 14ee4710dc1e4be99a201115008e5d53, 6255407488f44f23879d2d2262435a02
I20260806 19:31:44.229230 7823 raft_consensus.cc:2726] T e734f71153014584bce7e301926f06cf P 01428b0d3a2e4707aa1b684d2539dcac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 19:31:44.260452 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:44.259609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:58041)
0806 19:31:44.260166 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:44.260275 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":255,"threads_started":1}
I20260806 19:31:44.260492 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:44.259444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:46147)
0806 19:31:44.260070 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:44.260197 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":317,"threads_started":1}
I20260806 19:31:44.752115 7827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:44.751315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:55717)
0806 19:31:44.751844 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:44.751936 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":267,"threads_started":1}
I20260806 19:31:45.262240 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:45.261447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:39921)
0806 19:31:45.261950 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:45.262041 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":278,"threads_started":1}
I20260806 19:31:45.262607 7831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:45.261576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:40957)
0806 19:31:45.262303 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:45.262407 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":508,"threads_started":1}
I20260806 19:31:45.754069 7833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:45.753195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:37293)
0806 19:31:45.753758 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:45.753856 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":296,"threads_started":1}
I20260806 19:31:46.264124 7834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:46.263199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:36147)
0806 19:31:46.263764 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:46.263890 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":265,"threads_started":1}
I20260806 19:31:46.264292 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:46.263545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:42785)
0806 19:31:46.264015 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:46.264104 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":245,"threads_started":1}
I20260806 19:31:46.755817 7837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:46.755018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:41623)
0806 19:31:46.755510 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:46.755602 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":250,"threads_started":1}
I20260806 19:31:47.266212 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:47.265283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:55683)
0806 19:31:47.265881 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:47.265986 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":311,"threads_started":1}
I20260806 19:31:47.266911 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:47.265730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:57535)
0806 19:31:47.266651 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:47.266739 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":802,"thread_start_us":669,"threads_started":1}
I20260806 19:31:47.758018 7840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:47.757164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.66:49185)
0806 19:31:47.757715 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:47.757845 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":302,"threads_started":1}
I20260806 19:31:48.248507 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 7122
I20260806 19:31:48.268484 7843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:48.267601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.67:40389)
0806 19:31:48.268115 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:48.268260 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":268,"threads_started":1}
I20260806 19:31:48.269032 7848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:48.267886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43143 (local address 127.17.18.65:33285)
0806 19:31:48.268530 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:48.268806 (+ 276us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:43143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":320,"threads_started":1}
I20260806 19:31:48.271039 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:48.249788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.17.18.65:42413)
0806 19:31:48.250453 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:48.250461 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:48.250491 (+ 30us) server_negotiation.cc:407] Connection header received
0806 19:31:48.250559 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:48.250566 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:48.250848 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:48.251030 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:48.253040 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.254164 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.255526 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.256157 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.256300 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:48.263936 (+ 7636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:48.263958 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:48.263977 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:48.264030 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:48.267116 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.268419 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.268432 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.268436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.268653 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.269124 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.269130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.269134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.269685 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:48.270017 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:48.270388 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 19:31:48.270711 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":285,"threads_started":1}
I20260806 19:31:48.272440 7362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:48.364348 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 7122
I20260806 19:31:48.392938 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 7375
I20260806 19:31:48.407181 7850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:48.393735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.17.18.66:45185)
0806 19:31:48.394204 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:48.394209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:48.394226 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:31:48.394284 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:48.394288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:48.394349 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:48.394449 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:48.395918 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.396719 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.398193 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.398649 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.398757 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:48.401580 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:48.401585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:48.401588 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:48.401624 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:48.404386 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.405077 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.405081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.405084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.405211 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.405805 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.405808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.405810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.406106 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:48.406336 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:48.406663 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 19:31:48.406878 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":237,"threads_started":1}
I20260806 19:31:48.407904 7555 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:48.494402 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 7375
I20260806 19:31:48.527120 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 7566
I20260806 19:31:48.542248 7852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:48.528034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49020 (local address 127.17.18.67:43607)
0806 19:31:48.528600 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:48.528605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:48.528625 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:48.528695 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:48.528699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:48.528774 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:48.528870 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:48.530523 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.531627 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.533101 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:48.533647 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:48.533766 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:48.536674 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:48.536680 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:48.536683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:48.536741 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:48.539543 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.540304 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.540308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.540310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.540463 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:48.540794 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:48.540797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:48.540799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:48.541083 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:48.541313 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:48.541752 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 19:31:48.541947 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":306,"threads_started":1}
I20260806 19:31:48.543006 7750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:48.630159 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 7566
2026-08-06T19:31:48Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25450 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:31:48 dist-test-slave-f0tn krb5kdc[7859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:31:48 dist-test-slave-f0tn krb5kdc[7859](info): set up 2 sockets
Aug 06 19:31:48 dist-test-slave-f0tn krb5kdc[7859](info): commencing operation
krb5kdc: starting...
W20260806 19:31:49.874270 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.006s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:31:50 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:31:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:31:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:31:50.214327 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:50.584052 7879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:50.584436 7879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:50.584576 7879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:50.592221 7879 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 19:31:50.592356 7879 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 19:31:50.592414 7879 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 19:31:50.592490 7879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:31:50.592566 7879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:50.592664 7879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:50.592728 7879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:31:50.592804 7879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:31:50.603503 7879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:50.604907 7879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:50.606395 7879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:50.619236 7884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:50.619413 7879 server_base.cc:1034] running on GCE node
W20260806 19:31:50.619155 7885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:50.619127 7887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:50.620559 7879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:50.622202 7879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:50.623471 7879 hybrid_clock.cc:648] HybridClock initialized: now 1786044710623389 us; error 47 us; skew 500 ppm
I20260806 19:31:50.623857 7879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:50 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:50.627399 7879 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:31:50.629055 7879 webserver.cc:460] Webserver started at http://127.17.18.126:34863/ using document root <none> and password file <none>
I20260806 19:31:50.629901 7879 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:50.630019 7879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:50.630354 7879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:50.633788 7879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "c6e25c840caa4fa68bc37570492e6e4e"
format_stamp: "Formatted at 2026-08-06 19:31:50 on dist-test-slave-f0tn"
server_key: "be5717773733883b9a09f188bf42dcb3"
server_key_iv: "4dcffe8e576ebc45b98fac551503bc4e"
server_key_version: "encryptionkey@0"
I20260806 19:31:50.634747 7879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "c6e25c840caa4fa68bc37570492e6e4e"
format_stamp: "Formatted at 2026-08-06 19:31:50 on dist-test-slave-f0tn"
server_key: "be5717773733883b9a09f188bf42dcb3"
server_key_iv: "4dcffe8e576ebc45b98fac551503bc4e"
server_key_version: "encryptionkey@0"
I20260806 19:31:50.640705 7879 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:31:50.644833 7894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:50.646502 7879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:50.646745 7879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "c6e25c840caa4fa68bc37570492e6e4e"
format_stamp: "Formatted at 2026-08-06 19:31:50 on dist-test-slave-f0tn"
server_key: "be5717773733883b9a09f188bf42dcb3"
server_key_iv: "4dcffe8e576ebc45b98fac551503bc4e"
server_key_version: "encryptionkey@0"
I20260806 19:31:50.646991 7879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:50.661533 7879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:50.666311 7879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:50.666615 7879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:50.685832 7879 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45293
I20260806 19:31:50.685855 7976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45293 every 8 connection(s)
I20260806 19:31:50.687304 7879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:31:50.688758 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 7879
I20260806 19:31:50.689028 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:31:50.689918 17481 external_mini_cluster.cc:1428] Setting key 947d3d5d1d19a211b023dba29568f699
I20260806 19:31:50.692472 7977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:31:50 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:50.706481 7977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap starting.
I20260806 19:31:50.710069 7977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:50.711251 7977 log.cc:824] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:50.714505 7977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: No bootstrap required, opened a new log
I20260806 19:31:50.715066 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:50.692092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53966 (local address 127.17.18.126:45293)
0806 19:31:50.692939 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:50.692950 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:50.692994 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:31:50.694748 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:50.694774 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:50.695205 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:50.695548 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:50.697504 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:50.698955 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:50.700826 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:50.701681 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:50.701866 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:50.707256 (+ 5390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:50.707267 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:50.707286 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:50.707336 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:50.710565 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:50.711374 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:50.711383 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:50.711397 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:50.711605 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:50.712021 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:50.712026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:50.712028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:50.712656 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:50.712955 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:50.713492 (+ 537us) server_negotiation.cc:299] Negotiation successful
0806 19:31:50.713962 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":627,"thread_start_us":365,"threads_started":1}
I20260806 19:31:50.723126 7977 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:31:50.723567 7977 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:50.723664 7977 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Initialized, Role: FOLLOWER
I20260806 19:31:50.724371 7977 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:31:50.724642 7977 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:31:50.724802 7977 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:31:50.725003 7977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:50.727429 7977 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:31:50.727965 7977 leader_election.cc:302] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6e25c840caa4fa68bc37570492e6e4e; no voters:
I20260806 19:31:50.728617 7977 leader_election.cc:288] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:31:50.728729 7984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:50.730059 7984 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 LEADER]: Becoming Leader. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Running, Role: LEADER
I20260806 19:31:50.730623 7984 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:31:50.731000 7977 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:31:50.733580 7986 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:31:50.733577 7988 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e25c840caa4fa68bc37570492e6e4e. Latest consensus state: current_term: 1 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:31:50.734176 7986 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:50.734184 7988 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:31:50.735153 7993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:31:50.744277 7993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:31:50.754889 7993 catalog_manager.cc:1347] Generated new cluster ID: 8432dee565d64c839c1ca60289dd941b
I20260806 19:31:50.755036 7993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:31:50.766423 7993 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:31:50.768484 7993 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:31:50.778422 7993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Generated new TSK 0
I20260806 19:31:50.779675 7993 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:31:50.867179 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:51.259223 8016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:51.259574 8016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:51.259721 8016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:51.267475 8016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:51.267648 8016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:51.267809 8016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:31:51.279122 8016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:51.280566 8016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:51.282241 8016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:51.296965 8023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:51.296931 8024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:51.297009 8028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:51.297967 8016 server_base.cc:1034] running on GCE node
I20260806 19:31:51.298637 8016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:51.299651 8016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:51.300879 8016 hybrid_clock.cc:648] HybridClock initialized: now 1786044711300823 us; error 48 us; skew 500 ppm
I20260806 19:31:51.301241 8016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:51 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044711, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:51.304749 8016 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:31:51.306380 8016 webserver.cc:460] Webserver started at http://127.17.18.65:35683/ using document root <none> and password file <none>
I20260806 19:31:51.307077 8016 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:51.307191 8016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:51.307473 8016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:51.310621 8016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "5ea989f3bf78454da930934fb21a41f8"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "6a71c9f471086ee613802f555f6ba4aa"
server_key_iv: "b482c173f6ff86133862758c3ec29c88"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.311373 8016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "5ea989f3bf78454da930934fb21a41f8"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "6a71c9f471086ee613802f555f6ba4aa"
server_key_iv: "b482c173f6ff86133862758c3ec29c88"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.316915 8016 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 19:31:51.320838 8039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:51.322475 8016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 19:31:51.322651 8016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5ea989f3bf78454da930934fb21a41f8"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "6a71c9f471086ee613802f555f6ba4aa"
server_key_iv: "b482c173f6ff86133862758c3ec29c88"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.322890 8016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:51.347465 8016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:51.352249 8016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:51.352561 8016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:51.353765 8016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:51.355254 8016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:51.355338 8016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:51.355443 8016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:51.355487 8016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:51.390497 8016 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42429
I20260806 19:31:51.390552 8208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42429 every 8 connection(s)
I20260806 19:31:51.391937 8016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:31:51.394590 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 8016
I20260806 19:31:51.394855 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:31:51.395744 17481 external_mini_cluster.cc:1428] Setting key 405be3de5b2244cc39aa057f75418e80
Aug 06 19:31:51 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044711, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:51.419730 8211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:51.394894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:53859 (local address 127.17.18.126:45293)
0806 19:31:51.395448 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:51.395455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:51.396806 (+ 1351us) server_negotiation.cc:407] Connection header received
0806 19:31:51.398598 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:51.398604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:51.398687 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:51.398798 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:51.400886 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:51.402066 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:51.404640 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:51.405291 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:51.405461 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:51.411291 (+ 5830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:51.411300 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:51.411304 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:51.411357 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:51.414982 (+ 3625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:51.416328 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:51.416335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:51.416339 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:51.416527 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:51.417204 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:51.417210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:51.417213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:51.417691 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:51.417852 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:51.418964 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0806 19:31:51.419263 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":267,"threads_started":1}
I20260806 19:31:51.421051 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:51.395476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:53859)
0806 19:31:51.396354 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:51.396411 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:51.398300 (+ 1889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:51.399006 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:51.399015 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:51.399735 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:51.400620 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:51.400656 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:51.402294 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:51.402300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:51.404423 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:51.404443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:51.405622 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:51.405631 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:51.405895 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:51.406689 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:51.406724 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:51.410965 (+ 4241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:51.415234 (+ 4269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:51.415248 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:51.415273 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:51.416097 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:51.416713 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:51.416718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:51.416722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:51.417052 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:51.417908 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:51.417917 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:51.418457 (+ 540us) client_negotiation.cc:769] Sending connection context
0806 19:31:51.418803 (+ 346us) client_negotiation.cc:240] Negotiation successful
0806 19:31:51.419510 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":363,"threads_started":1}
I20260806 19:31:51.423074 8209 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:31:51.423468 8209 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:51.424543 8209 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:31:51.427347 7923 ts_manager.cc:194] Registered new tserver with Master: 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429)
I20260806 19:31:51.429581 7923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:53859
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:31:51.481405 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:31:51.870292 8216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:51.870677 8216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:51.870779 8216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:51.878990 8216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:51.879133 8216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:51.879256 8216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:31:51.889585 8216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:51.890967 8216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:51.892371 8216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:51.907135 8224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:51.907238 8226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:51.907212 8229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:51.907929 8216 server_base.cc:1034] running on GCE node
I20260806 19:31:51.908730 8216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:51.909878 8216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:51.911149 8216 hybrid_clock.cc:648] HybridClock initialized: now 1786044711911070 us; error 44 us; skew 500 ppm
I20260806 19:31:51.911525 8216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:51 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044711, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:51.915076 8216 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:31:51.916858 8216 webserver.cc:460] Webserver started at http://127.17.18.66:36981/ using document root <none> and password file <none>
I20260806 19:31:51.917711 8216 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:51.917852 8216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:51.918191 8216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:51.921419 8216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "e8b5943b6ff74c51acb534be843d1ffc"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "c9f4ac98ce03a29271cf3b9dbf2f8288"
server_key_iv: "b80b273c44a830d1ec2eeed6464cdac6"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.922413 8216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "e8b5943b6ff74c51acb534be843d1ffc"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "c9f4ac98ce03a29271cf3b9dbf2f8288"
server_key_iv: "b80b273c44a830d1ec2eeed6464cdac6"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.928570 8216 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:31:51.932670 8238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:51.934410 8216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:51.934612 8216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "e8b5943b6ff74c51acb534be843d1ffc"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "c9f4ac98ce03a29271cf3b9dbf2f8288"
server_key_iv: "b80b273c44a830d1ec2eeed6464cdac6"
server_key_version: "encryptionkey@0"
I20260806 19:31:51.934813 8216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:51.972203 8216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:51.977121 8216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:51.977440 8216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:51.978542 8216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:51.980077 8216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:51.980159 8216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:51.980268 8216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:51.980326 8216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:52.015033 8216 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:32871
I20260806 19:31:52.015074 8402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:32871 every 8 connection(s)
I20260806 19:31:52.016499 8216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:31:52.017727 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 8216
I20260806 19:31:52.017939 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:31:52.018556 17481 external_mini_cluster.cc:1428] Setting key e3de86b2e42988b85be511b79505a8a2
Aug 06 19:31:52 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044711, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:52.041872 8406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.020027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:36541 (local address 127.17.18.126:45293)
0806 19:31:52.020561 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.020567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.021944 (+ 1377us) server_negotiation.cc:407] Connection header received
0806 19:31:52.024241 (+ 2297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.024248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.024340 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.024463 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:52.026546 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.027603 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.029498 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.030149 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.030303 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.034598 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:52.034607 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:52.034611 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:52.034658 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:52.037717 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.038930 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.038935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.038938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.039122 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.039735 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.039740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.039743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.040104 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:52.040281 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.041287 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.041565 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":270,"threads_started":1}
I20260806 19:31:52.043339 8410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.020748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:36541)
0806 19:31:52.021744 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.021805 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.023890 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.024827 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.024842 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.025581 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:52.026327 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.026354 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.027830 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.027873 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.029275 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.029292 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.030432 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.030438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.030688 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.031487 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:52.031527 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:52.034243 (+ 2716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:52.037930 (+ 3687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:52.037942 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:52.037964 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:52.038709 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:52.039285 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:52.039290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:52.039293 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:52.039590 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:52.040287 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:52.040296 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:52.040801 (+ 505us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.041135 (+ 334us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.041855 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":389,"threads_started":1}
I20260806 19:31:52.045104 8403 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:31:52.045526 8403 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:52.046379 8403 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:31:52.048074 7923 ts_manager.cc:194] Registered new tserver with Master: e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871)
I20260806 19:31:52.048962 7923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:36541
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:31:52.097218 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:31:52.433365 8209 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
W20260806 19:31:52.468160 8418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:31:52.468601 8418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:31:52.468770 8418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:31:52.476888 8418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:31:52.477046 8418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:31:52.477211 8418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:31:52.487919 8418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:31:52.489428 8418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:31:52.490939 8418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:31:52.505780 8431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:52.505743 8435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:31:52.505708 8432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:31:52.506412 8418 server_base.cc:1034] running on GCE node
I20260806 19:31:52.507186 8418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:31:52.508232 8418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:31:52.509466 8418 hybrid_clock.cc:648] HybridClock initialized: now 1786044712509408 us; error 55 us; skew 500 ppm
I20260806 19:31:52.509816 8418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:31:52 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:31:52.513911 8418 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:31:52.516753 8418 webserver.cc:460] Webserver started at http://127.17.18.67:42543/ using document root <none> and password file <none>
I20260806 19:31:52.517711 8418 fs_manager.cc:359] Metadata directory not provided
I20260806 19:31:52.517877 8418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:31:52.518304 8418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:31:52.521692 8418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "51615d22d8284d6bb784a3d5cd906d9c"
format_stamp: "Formatted at 2026-08-06 19:31:52 on dist-test-slave-f0tn"
server_key: "7542bd12185aa875330f63879a3160fc"
server_key_iv: "8a168744a471ce704998880319032a4c"
server_key_version: "encryptionkey@0"
I20260806 19:31:52.522508 8418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "51615d22d8284d6bb784a3d5cd906d9c"
format_stamp: "Formatted at 2026-08-06 19:31:52 on dist-test-slave-f0tn"
server_key: "7542bd12185aa875330f63879a3160fc"
server_key_iv: "8a168744a471ce704998880319032a4c"
server_key_version: "encryptionkey@0"
I20260806 19:31:52.528455 8418 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:31:52.532438 8450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:52.533974 8418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:31:52.534150 8418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "51615d22d8284d6bb784a3d5cd906d9c"
format_stamp: "Formatted at 2026-08-06 19:31:52 on dist-test-slave-f0tn"
server_key: "7542bd12185aa875330f63879a3160fc"
server_key_iv: "8a168744a471ce704998880319032a4c"
server_key_version: "encryptionkey@0"
I20260806 19:31:52.534376 8418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:31:52.555573 8418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:31:52.560432 8418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:31:52.560760 8418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:31:52.561981 8418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:31:52.563731 8418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:31:52.563824 8418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:52.563928 8418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:31:52.563972 8418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:31:52.596323 8418 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44827
I20260806 19:31:52.596369 8619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44827 every 8 connection(s)
I20260806 19:31:52.597718 8418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:31:52.602020 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 8418
I20260806 19:31:52.602228 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:31:52.602895 17481 external_mini_cluster.cc:1428] Setting key 5f6897383270825f192549adb01b4ad6
Aug 06 19:31:52 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:31:52.620635 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.600758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:37271 (local address 127.17.18.126:45293)
0806 19:31:52.601233 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.601238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.602423 (+ 1185us) server_negotiation.cc:407] Connection header received
0806 19:31:52.605040 (+ 2617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.605047 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.605152 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.605248 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:52.607241 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.608090 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.609838 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.610274 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.610381 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.614221 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:52.614227 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:52.614231 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:52.614269 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:52.616911 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.617960 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.617967 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.617970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.618121 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.618606 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.618612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.618615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.619015 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:52.619180 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.619956 (+ 776us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.620222 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":241,"threads_started":1}
I20260806 19:31:52.621976 8624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.601188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:37271)
0806 19:31:52.602211 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.602270 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.604625 (+ 2355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.605587 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.605598 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.606295 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:31:52.607046 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.607069 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.608262 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.608267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.609665 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.609680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.610503 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.610509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.610735 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.611488 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:31:52.611523 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:31:52.613952 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:31:52.617088 (+ 3136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:52.617100 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:52.617119 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:52.617769 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:52.618242 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:31:52.618246 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:31:52.618248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:31:52.618465 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:31:52.619155 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:31:52.619163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:31:52.619566 (+ 403us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.619832 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.620461 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":383,"threads_started":1}
I20260806 19:31:52.623745 8620 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:31:52.624145 8620 heartbeater.cc:464] Registering TS with master...
I20260806 19:31:52.624956 8620 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:31:52.626832 7923 ts_manager.cc:194] Registered new tserver with Master: 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827)
I20260806 19:31:52.627781 7923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:37271
I20260806 19:31:52.631750 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:31:52.650547 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.636517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.17.18.126:45293)
0806 19:31:52.636704 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.636708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.637149 (+ 441us) server_negotiation.cc:407] Connection header received
0806 19:31:52.637256 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.637261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.637336 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.637473 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:52.639254 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.640171 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.641734 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.642191 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.642301 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.644777 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:52.644783 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:52.644787 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:52.644826 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:52.647646 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.648477 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.648482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.648485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.648635 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.649124 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.649128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.649130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.649563 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:52.649778 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.650105 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.650307 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:31:52.655383 7923 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:31:52.662833 7923 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:31:52.703498 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.677777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:44827 (local address 127.0.0.1:47018)
0806 19:31:52.691244 (+ 13467us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.691269 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.691431 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.692965 (+ 1534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.692970 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.692998 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:52.693490 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.693505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.695651 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.695657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.698467 (+ 2810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.698486 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.702295 (+ 3809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.702303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.702561 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.702637 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.702781 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.703014 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13295,"mutex_wait_us":1,"thread_start_us":13083,"threads_started":1}
I20260806 19:31:52.704993 8638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.676669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:32871 (local address 127.0.0.1:40692)
0806 19:31:52.683661 (+ 6992us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.683724 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.683970 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.692612 (+ 8642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.692622 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.692660 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:52.693588 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.693606 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.695842 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.695852 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.701691 (+ 5839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.701709 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.704137 (+ 2428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.704143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.704333 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.704366 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.704454 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.704604 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6633,"mutex_wait_us":3365,"thread_start_us":7554,"threads_started":1}
I20260806 19:31:52.705039 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.677995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47018 (local address 127.17.18.67:44827)
0806 19:31:52.692355 (+ 14360us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.692362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.692390 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:31:52.692468 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.692474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.692636 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.692947 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:52.693759 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.695493 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.698737 (+ 3244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.700399 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.704106 (+ 3707us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.704380 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.704469 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.704656 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14202,"thread_start_us":14002,"threads_started":1}
I20260806 19:31:52.705986 8639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.676916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40692 (local address 127.17.18.66:32871)
0806 19:31:52.691560 (+ 14644us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.691571 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.691613 (+ 42us) server_negotiation.cc:407] Connection header received
0806 19:31:52.691745 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.691754 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.692055 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.692284 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:52.693873 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.695628 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.701942 (+ 6314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.703558 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.703680 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.703905 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.705430 (+ 1525us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.705633 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14429,"thread_start_us":14613,"threads_started":1}
I20260806 19:31:52.709673 8521 tablet_service.cc:1467] Processing CreateTablet for tablet 551e9af77f7a4058896049f07df0412d (DEFAULT_TABLE table=test-table [id=03c585ecab4e4621a6690328fadb46ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:52.710861 8644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.697418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42429 (local address 127.0.0.1:44444)
0806 19:31:52.701772 (+ 4354us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.701792 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.701931 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.702796 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.702801 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.702828 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:52.703238 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.703252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.706270 (+ 3018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.706276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.708268 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.708286 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.709894 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.709902 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.710084 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.710123 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.710216 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.710382 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4182,"thread_start_us":4024,"threads_started":1}
I20260806 19:31:52.711428 8521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 551e9af77f7a4058896049f07df0412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:52.712522 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.689879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.17.18.65:42429)
0806 19:31:52.701355 (+ 11476us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.701366 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.702080 (+ 714us) server_negotiation.cc:407] Connection header received
0806 19:31:52.702226 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.702235 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.702541 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.703477 (+ 936us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:52.704053 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.705918 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.708488 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.709596 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.711460 (+ 1864us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.711809 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.711902 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.712087 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11274,"thread_start_us":11093,"threads_started":1}
I20260806 19:31:52.712813 8318 tablet_service.cc:1467] Processing CreateTablet for tablet 551e9af77f7a4058896049f07df0412d (DEFAULT_TABLE table=test-table [id=03c585ecab4e4621a6690328fadb46ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:52.714632 8318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 551e9af77f7a4058896049f07df0412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:52.716747 8111 tablet_service.cc:1467] Processing CreateTablet for tablet 551e9af77f7a4058896049f07df0412d (DEFAULT_TABLE table=test-table [id=03c585ecab4e4621a6690328fadb46ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:31:52.718463 8111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 551e9af77f7a4058896049f07df0412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:31:52.724185 8647 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Bootstrap starting.
I20260806 19:31:52.728179 8647 tablet_bootstrap.cc:654] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:52.729622 8647 log.cc:824] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:52.730626 8648 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Bootstrap starting.
I20260806 19:31:52.734454 8647 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: No bootstrap required, opened a new log
I20260806 19:31:52.734427 8651 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Bootstrap starting.
I20260806 19:31:52.734783 8647 ts_tablet_manager.cc:1397] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260806 19:31:52.735045 8648 tablet_bootstrap.cc:654] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:52.736506 8648 log.cc:824] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:52.737820 8651 tablet_bootstrap.cc:654] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Neither blocks nor log segments found. Creating new log.
I20260806 19:31:52.739094 8651 log.cc:824] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:31:52.740358 8648 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: No bootstrap required, opened a new log
I20260806 19:31:52.740717 8648 ts_tablet_manager.cc:1397] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 19:31:52.742353 8651 tablet_bootstrap.cc:492] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: No bootstrap required, opened a new log
I20260806 19:31:52.742641 8651 ts_tablet_manager.cc:1397] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 19:31:52.745810 8647 raft_consensus.cc:348] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.746363 8647 raft_consensus.cc:374] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:52.746487 8647 raft_consensus.cc:729] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51615d22d8284d6bb784a3d5cd906d9c, State: Initialized, Role: FOLLOWER
I20260806 19:31:52.747237 8647 consensus_queue.cc:260] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.748538 8620 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
I20260806 19:31:52.750463 8647 ts_tablet_manager.cc:1428] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260806 19:31:52.751001 8651 raft_consensus.cc:348] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.751446 8651 raft_consensus.cc:374] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:52.751559 8651 raft_consensus.cc:729] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ea989f3bf78454da930934fb21a41f8, State: Initialized, Role: FOLLOWER
I20260806 19:31:52.752171 8651 consensus_queue.cc:260] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.752169 8648 raft_consensus.cc:348] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.752741 8648 raft_consensus.cc:374] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:31:52.752853 8648 raft_consensus.cc:729] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b5943b6ff74c51acb534be843d1ffc, State: Initialized, Role: FOLLOWER
I20260806 19:31:52.753518 8648 consensus_queue.cc:260] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.754874 8651 ts_tablet_manager.cc:1428] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260806 19:31:52.757130 8403 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
I20260806 19:31:52.757747 8648 ts_tablet_manager.cc:1428] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Time spent starting tablet: real 0.017s user 0.008s sys 0.010s
W20260806 19:31:52.768757 8404 tablet.cc:2369] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:52.812780 8657 raft_consensus.cc:482] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:31:52.813146 8657 raft_consensus.cc:504] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.815105 8657 leader_election.cc:288] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871), 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827)
I20260806 19:31:52.824643 8639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.815658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:34537 (local address 127.17.18.66:32871)
0806 19:31:52.815883 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.815889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.816935 (+ 1046us) server_negotiation.cc:407] Connection header received
0806 19:31:52.817189 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.817195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.817278 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.817406 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:52.818265 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.819032 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.821997 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.823297 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.823480 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.823571 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.824208 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.824363 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:31:52.824643 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.815732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:43785 (local address 127.17.18.67:44827)
0806 19:31:52.815915 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.815922 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.816935 (+ 1013us) server_negotiation.cc:407] Connection header received
0806 19:31:52.817194 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.817199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.817278 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.817409 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:31:52.818257 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.819143 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.822036 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.823297 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.823490 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.823571 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.824208 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.824363 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:31:52.824916 8660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.815765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:32871 (local address 127.17.18.65:34537)
0806 19:31:52.816787 (+ 1022us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.816808 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.817005 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.817436 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.817441 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.817489 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:52.818056 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.818066 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.819193 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.819197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.821775 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.821794 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.823664 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.823670 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.823924 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.824050 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.824152 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.824354 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":192,"spinlock_wait_cycles":56576,"thread_start_us":580,"threads_started":1}
I20260806 19:31:52.825299 8659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.815789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:44827 (local address 127.17.18.65:43785)
0806 19:31:52.816831 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0806 19:31:52.816846 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:31:52.816989 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:31:52.817436 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:31:52.817441 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:31:52.817486 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:31:52.818026 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.818044 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.819275 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.819279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.821780 (+ 2501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:31:52.821794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.823638 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.823651 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:31:52.823932 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.823972 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 19:31:52.824127 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 19:31:52.824354 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"mutex_wait_us":125,"spinlock_wait_cycles":54272,"thread_start_us":548,"threads_started":1}
I20260806 19:31:52.826277 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "551e9af77f7a4058896049f07df0412d" candidate_uuid: "5ea989f3bf78454da930934fb21a41f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b5943b6ff74c51acb534be843d1ffc" is_pre_election: true
I20260806 19:31:52.826471 8549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "551e9af77f7a4058896049f07df0412d" candidate_uuid: "5ea989f3bf78454da930934fb21a41f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51615d22d8284d6bb784a3d5cd906d9c" is_pre_election: true
I20260806 19:31:52.826922 8342 raft_consensus.cc:2454] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ea989f3bf78454da930934fb21a41f8 in term 0.
I20260806 19:31:52.827042 8549 raft_consensus.cc:2454] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ea989f3bf78454da930934fb21a41f8 in term 0.
I20260806 19:31:52.827757 8043 leader_election.cc:302] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ea989f3bf78454da930934fb21a41f8, e8b5943b6ff74c51acb534be843d1ffc; no voters:
I20260806 19:31:52.828147 8657 raft_consensus.cc:2781] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:31:52.828323 8657 raft_consensus.cc:482] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:31:52.828421 8657 raft_consensus.cc:3037] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:52.830763 8657 raft_consensus.cc:504] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.831475 8657 leader_election.cc:288] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [CANDIDATE]: Term 1 election: Requested vote from peers e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871), 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827)
I20260806 19:31:52.832118 8549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "551e9af77f7a4058896049f07df0412d" candidate_uuid: "5ea989f3bf78454da930934fb21a41f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51615d22d8284d6bb784a3d5cd906d9c"
I20260806 19:31:52.832366 8549 raft_consensus.cc:3037] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:52.834887 8549 raft_consensus.cc:2454] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ea989f3bf78454da930934fb21a41f8 in term 1.
I20260806 19:31:52.835290 8342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "551e9af77f7a4058896049f07df0412d" candidate_uuid: "5ea989f3bf78454da930934fb21a41f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b5943b6ff74c51acb534be843d1ffc"
I20260806 19:31:52.835369 8044 leader_election.cc:302] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51615d22d8284d6bb784a3d5cd906d9c, 5ea989f3bf78454da930934fb21a41f8; no voters:
I20260806 19:31:52.835512 8342 raft_consensus.cc:3037] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:31:52.835711 8657 raft_consensus.cc:2781] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:31:52.836258 8657 raft_consensus.cc:686] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5ea989f3bf78454da930934fb21a41f8, State: Running, Role: LEADER
I20260806 19:31:52.836824 8657 consensus_queue.cc:237] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:31:52.838231 8342 raft_consensus.cc:2454] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ea989f3bf78454da930934fb21a41f8 in term 1.
I20260806 19:31:52.842454 7923 catalog_manager.cc:5495] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65). New cstate: current_term: 1 leader_uuid: "5ea989f3bf78454da930934fb21a41f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } health_report { overall_health: UNKNOWN } } }
W20260806 19:31:52.849479 8622 tablet.cc:2369] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:52.883891 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.877904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44458 (local address 127.17.18.65:42429)
0806 19:31:52.878105 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.878110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.878219 (+ 109us) server_negotiation.cc:407] Connection header received
0806 19:31:52.878424 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.878428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.878514 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.878649 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:31:52.879034 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.879783 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.881410 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.881896 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.882012 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.882716 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:31:52.883285 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:31:52.883409 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.883578 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.883659 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:31:52.893347 8342 raft_consensus.cc:1261] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Refusing update from remote peer 5ea989f3bf78454da930934fb21a41f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:31:52.893347 8549 raft_consensus.cc:1261] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Refusing update from remote peer 5ea989f3bf78454da930934fb21a41f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 19:31:52.894716 8210 tablet.cc:2369] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:31:52.894625 8661 consensus_queue.cc:1035] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:52.895123 8657 consensus_queue.cc:1035] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:31:52.922777 7922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:52.923158 7922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:31:52.927644 7922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Sending DeleteTablet for 3 replicas of tablet 551e9af77f7a4058896049f07df0412d
I20260806 19:31:52.929111 8521 tablet_service.cc:1514] Processing DeleteTablet for tablet 551e9af77f7a4058896049f07df0412d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:52 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:47018
I20260806 19:31:52.929155 8318 tablet_service.cc:1514] Processing DeleteTablet for tablet 551e9af77f7a4058896049f07df0412d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:52 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:40692
I20260806 19:31:52.929991 8111 tablet_service.cc:1514] Processing DeleteTablet for tablet 551e9af77f7a4058896049f07df0412d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:31:52 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:44444
I20260806 19:31:52.930526 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 8016
I20260806 19:31:52.941162 8684 tablet_replica.cc:330] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: stopping tablet replica
I20260806 19:31:52.941881 8683 tablet_replica.cc:330] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: stopping tablet replica
I20260806 19:31:52.942600 8683 raft_consensus.cc:2229] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:52.943162 8684 raft_consensus.cc:2229] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:31:52.944005 8684 raft_consensus.cc:2258] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:52.944622 8683 raft_consensus.cc:2258] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:52.947443 8683 ts_tablet_manager.cc:1905] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:52.949038 8684 ts_tablet_manager.cc:1905] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:31:52.950517 8682 tablet_replica.cc:330] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: stopping tablet replica
I20260806 19:31:52.950984 8682 raft_consensus.cc:2229] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:31:52.951553 8682 raft_consensus.cc:2258] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:31:52.954084 8682 ts_tablet_manager.cc:1905] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 19:31:52 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:31:52.961926 8682 ts_tablet_manager.cc:1918] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:52.962383 8682 log.cc:1196] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/551e9af77f7a4058896049f07df0412d
I20260806 19:31:52.963133 8682 ts_tablet_manager.cc:1939] T 551e9af77f7a4058896049f07df0412d P 51615d22d8284d6bb784a3d5cd906d9c: Deleting consensus metadata
I20260806 19:31:52.965181 8683 ts_tablet_manager.cc:1918] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:52.965444 7901 catalog_manager.cc:4841] TS 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827): tablet 551e9af77f7a4058896049f07df0412d (table test-table [id=03c585ecab4e4621a6690328fadb46ce]) successfully deleted
I20260806 19:31:52.966095 8683 log.cc:1196] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/551e9af77f7a4058896049f07df0412d
I20260806 19:31:52.966724 8683 ts_tablet_manager.cc:1939] T 551e9af77f7a4058896049f07df0412d P e8b5943b6ff74c51acb534be843d1ffc: Deleting consensus metadata
I20260806 19:31:52.967549 8684 ts_tablet_manager.cc:1918] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:31:52.967808 8684 log.cc:1196] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/551e9af77f7a4058896049f07df0412d
I20260806 19:31:52.968418 8684 ts_tablet_manager.cc:1939] T 551e9af77f7a4058896049f07df0412d P 5ea989f3bf78454da930934fb21a41f8: Deleting consensus metadata
I20260806 19:31:52.968864 7899 catalog_manager.cc:4841] TS e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871): tablet 551e9af77f7a4058896049f07df0412d (table test-table [id=03c585ecab4e4621a6690328fadb46ce]) successfully deleted
I20260806 19:31:52.969372 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:52.931964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44472 (local address 127.17.18.65:42429)
0806 19:31:52.932162 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:52.932168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:52.946120 (+ 13952us) server_negotiation.cc:407] Connection header received
0806 19:31:52.946689 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:52.946696 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:52.946797 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:52.946886 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:52.949287 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.950732 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.952918 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:52.953747 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:52.953871 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:52.959875 (+ 6004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:52.959899 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:52.959922 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:52.959982 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:52.964531 (+ 4549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.965760 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.965771 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.965774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.966035 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:52.967052 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:52.967057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:52.967060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:52.967616 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:52.967928 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:52.968643 (+ 715us) server_negotiation.cc:299] Negotiation successful
0806 19:31:52.968954 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":44}
I20260806 19:31:52.970479 8204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:52.970969 7899 catalog_manager.cc:4841] TS 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429): tablet 551e9af77f7a4058896049f07df0412d (table test-table [id=03c585ecab4e4621a6690328fadb46ce]) successfully deleted
I20260806 19:31:53.086843 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 8016
I20260806 19:31:53.118115 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 8216
Aug 06 19:31:53 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:31:53.135785 8639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:53.119121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40702 (local address 127.17.18.66:32871)
0806 19:31:53.119348 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:53.119354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:53.119376 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:31:53.119538 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:53.119542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:53.119613 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:53.119699 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:53.121141 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:53.122228 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:53.123872 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:53.124288 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:53.124411 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:53.128859 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:53.128881 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:53.128901 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:53.128947 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:53.132433 (+ 3486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:53.133427 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:53.133438 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:53.133441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:53.133597 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:53.134114 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:53.134118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:53.134120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:53.134626 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:53.134873 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:53.135248 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 19:31:53.135443 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 19:31:53.136559 8396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:53.232125 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 8216
I20260806 19:31:53.258693 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 8418
Aug 06 19:31:53 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:31:53.282889 8642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:31:53.259634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47020 (local address 127.17.18.67:44827)
0806 19:31:53.259888 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 19:31:53.259894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:31:53.259914 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:31:53.259975 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:31:53.259979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:31:53.260068 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:31:53.260160 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:31:53.261743 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:53.262508 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:53.264026 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:31:53.264506 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:31:53.264623 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:31:53.276282 (+ 11659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:31:53.276304 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:31:53.276324 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:31:53.276373 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:31:53.279513 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:53.280457 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:53.280468 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:53.280470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:53.280667 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:31:53.281241 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:31:53.281246 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:31:53.281248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:31:53.281796 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:31:53.282071 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 19:31:53.282401 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 19:31:53.282605 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 19:31:53.283758 8614 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:53.377429 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 8418
I20260806 19:31:53.401248 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 7879
I20260806 19:31:53.402524 7970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:31:53.517593 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 7879
I20260806 19:32:13.549443 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--webserver_interface=127.17.18.126
--webserver_port=34863
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:32:13.930825 8693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:13.931173 8693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:13.931304 8693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:13.939409 8693 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 19:32:13.939545 8693 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 19:32:13.939591 8693 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 19:32:13.939687 8693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:32:13.939760 8693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:13.939847 8693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:13.939903 8693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:32:13.939980 8693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:32:13.951373 8693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=34863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:13.952934 8693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:13.954466 8693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:13.982643 8704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:13.982549 8710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:13.982616 8706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:13.988794 8693 server_base.cc:1034] running on GCE node
I20260806 19:32:13.990090 8693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:13.991958 8693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:13.993222 8693 hybrid_clock.cc:648] HybridClock initialized: now 1786044733993140 us; error 53 us; skew 500 ppm
I20260806 19:32:13.993700 8693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:13 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044733, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:13.997617 8693 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:32:13.999487 8693 webserver.cc:460] Webserver started at http://127.17.18.126:34863/ using document root <none> and password file <none>
I20260806 19:32:14.000358 8693 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:14.000483 8693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:14.007253 8693 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260806 19:32:14.010859 8719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:14.012845 8693 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:32:14.013108 8693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "c6e25c840caa4fa68bc37570492e6e4e"
format_stamp: "Formatted at 2026-08-06 19:31:50 on dist-test-slave-f0tn"
server_key: "be5717773733883b9a09f188bf42dcb3"
server_key_iv: "4dcffe8e576ebc45b98fac551503bc4e"
server_key_version: "encryptionkey@0"
I20260806 19:32:14.014420 8693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:14.037319 8693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:14.042183 8693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:14.042500 8693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:14.063271 8693 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45293
I20260806 19:32:14.063325 8795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45293 every 8 connection(s)
I20260806 19:32:14.064994 8693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:32:14.068815 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 8693
I20260806 19:32:14.069985 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:42429
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=35683
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:32:14.074735 8796 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:32:14.079785 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap starting.
I20260806 19:32:14.103259 8796 log.cc:824] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:14.122620 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:32:14.123323 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap complete.
I20260806 19:32:14.135061 8796 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:14.136053 8796 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Initialized, Role: FOLLOWER
I20260806 19:32:14.136775 8796 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:14.137060 8796 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:32:14.137205 8796 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:32:14.137420 8796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 1 FOLLOWER]: Advancing to term 2
I20260806 19:32:14.142187 8796 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:14.142926 8796 leader_election.cc:302] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6e25c840caa4fa68bc37570492e6e4e; no voters:
I20260806 19:32:14.143605 8796 leader_election.cc:288] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 19:32:14.143842 8804 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Leader election won for term 2
I20260806 19:32:14.145110 8804 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 LEADER]: Becoming Leader. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Running, Role: LEADER
I20260806 19:32:14.145890 8804 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:14.146250 8796 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:32:14.151117 8806 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:32:14.152071 8806 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:14.152208 8809 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e25c840caa4fa68bc37570492e6e4e. Latest consensus state: current_term: 2 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:32:14.153903 8809 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:14.159617 8819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:32:14.170317 8819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:32:14.172771 8819 catalog_manager.cc:1259] Loaded cluster ID: 8432dee565d64c839c1ca60289dd941b
I20260806 19:32:14.173594 8819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:32:14.179454 8819 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:32:14.181793 8819 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Loaded TSK: 0
I20260806 19:32:14.219192 8819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Generated new TSK 1
I20260806 19:32:14.219697 8819 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:32:14.497109 8800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:14.497502 8800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:14.497668 8800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:14.506203 8800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:14.506351 8800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:14.506505 8800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:32:14.521068 8800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:42429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=35683
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:14.522785 8800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:14.524267 8800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:14.539115 8840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:14.539386 8842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:14.539572 8838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:14.541002 8800 server_base.cc:1034] running on GCE node
I20260806 19:32:14.541929 8800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:14.543288 8800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:14.544574 8800 hybrid_clock.cc:648] HybridClock initialized: now 1786044734544492 us; error 68 us; skew 500 ppm
I20260806 19:32:14.545013 8800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:14 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044734, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:14.549773 8800 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:32:14.552080 8800 webserver.cc:460] Webserver started at http://127.17.18.65:35683/ using document root <none> and password file <none>
I20260806 19:32:14.553092 8800 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:14.553279 8800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:14.561477 8800 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 19:32:14.564728 8854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:14.566367 8800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 19:32:14.566555 8800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5ea989f3bf78454da930934fb21a41f8"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "6a71c9f471086ee613802f555f6ba4aa"
server_key_iv: "b482c173f6ff86133862758c3ec29c88"
server_key_version: "encryptionkey@0"
I20260806 19:32:14.567618 8800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:14.603018 8800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:14.607976 8800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:14.608280 8800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:14.609514 8800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:14.611177 8800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:14.611297 8800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:14.611419 8800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:14.611496 8800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:14.647523 8800 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42429
I20260806 19:32:14.647590 9038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42429 every 8 connection(s)
I20260806 19:32:14.649179 8800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:32:14.650653 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 8800
I20260806 19:32:14.651580 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:32871
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=36981
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:32:14 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044734, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:14.678665 9043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:14.653199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:56157)
0806 19:32:14.654202 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:14.654262 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:14.656190 (+ 1928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:14.658101 (+ 1911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:14.658113 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:14.658800 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:14.659410 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:14.659431 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:14.661218 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:14.661222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:14.662632 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:14.662650 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:14.664098 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:14.664119 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:14.664596 (+ 477us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:14.665573 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:14.665604 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:14.668236 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:14.672875 (+ 4639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:14.672885 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:14.672901 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:14.673614 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:14.674291 (+ 677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:14.674294 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:14.674297 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:14.674512 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:14.675614 (+ 1102us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:14.675623 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:14.676123 (+ 500us) client_negotiation.cc:769] Sending connection context
0806 19:32:14.676488 (+ 365us) client_negotiation.cc:240] Negotiation successful
0806 19:32:14.677152 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":377,"threads_started":1}
I20260806 19:32:14.678655 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:14.652827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:56157 (local address 127.17.18.126:45293)
0806 19:32:14.653548 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:14.653568 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:14.654720 (+ 1152us) server_negotiation.cc:407] Connection header received
0806 19:32:14.656853 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:14.656866 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:14.657345 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:14.657847 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:14.659655 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:14.660978 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:14.662828 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:14.663770 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:14.664035 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:14.668664 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:14.668677 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:14.668700 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:14.668759 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:14.672619 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:14.673822 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:14.673836 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:14.673846 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:14.674126 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:14.674644 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:14.674649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:14.674652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:14.675406 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:14.675626 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:14.677030 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0806 19:32:14.677524 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":293,"threads_started":1}
I20260806 19:32:14.681840 9039 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:32:14.682168 9039 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:14.682957 9039 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:32:14.685258 8747 ts_manager.cc:194] Registered new tserver with Master: 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429)
I20260806 19:32:14.686851 8747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:56157
W20260806 19:32:15.031877 9044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:15.032195 9044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:15.032358 9044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:15.039964 9044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:15.040122 9044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:15.040288 9044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:32:15.050972 9044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:32871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=36981
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:15.052434 9044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:15.053978 9044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:15.069690 9051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:15.070189 9053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:15.070542 9050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:15.071976 9044 server_base.cc:1034] running on GCE node
I20260806 19:32:15.072662 9044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:15.073853 9044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:15.075102 9044 hybrid_clock.cc:648] HybridClock initialized: now 1786044735075045 us; error 50 us; skew 500 ppm
I20260806 19:32:15.075520 9044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:15 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044735, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:15.078980 9044 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:32:15.080741 9044 webserver.cc:460] Webserver started at http://127.17.18.66:36981/ using document root <none> and password file <none>
I20260806 19:32:15.081585 9044 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:15.081775 9044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:15.087984 9044 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 19:32:15.091338 9061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.092849 9044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 19:32:15.093029 9044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "e8b5943b6ff74c51acb534be843d1ffc"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "c9f4ac98ce03a29271cf3b9dbf2f8288"
server_key_iv: "b80b273c44a830d1ec2eeed6464cdac6"
server_key_version: "encryptionkey@0"
I20260806 19:32:15.094174 9044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:15.112074 9044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:15.116920 9044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:15.117228 9044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:15.118414 9044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:15.119961 9044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:15.120075 9044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.120190 9044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:15.120268 9044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.155501 9044 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:32871
I20260806 19:32:15.155591 9232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:32871 every 8 connection(s)
I20260806 19:32:15.157117 9044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:32:15.160385 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 9044
I20260806 19:32:15.161062 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:44827
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=42543
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 19:32:15 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044735, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:15.181516 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.160130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:54387 (local address 127.17.18.126:45293)
0806 19:32:15.160393 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.160399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.161992 (+ 1593us) server_negotiation.cc:407] Connection header received
0806 19:32:15.164055 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.164061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.164211 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.164422 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:15.166706 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.167659 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.169628 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.170233 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.170375 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.174621 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:15.174629 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:15.174633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:15.174689 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:15.177602 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.178674 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.178678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.178696 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.178834 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.179430 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.179436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.179439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.179794 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:15.179915 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.180963 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.181174 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260806 19:32:15.183099 9237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.160805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:54387)
0806 19:32:15.161759 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:15.161813 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:15.163706 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:15.164944 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:15.164957 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:15.165768 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:15.166452 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.166475 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.167939 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.167944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.169420 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.169443 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.170520 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.170526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.170789 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.171605 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:15.171634 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:15.174279 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:15.177837 (+ 3558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:15.177848 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:15.177869 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:15.178528 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:15.178970 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:15.178975 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:15.178978 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:15.179271 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:15.179938 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:15.179946 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:15.180513 (+ 567us) client_negotiation.cc:769] Sending connection context
0806 19:32:15.180850 (+ 337us) client_negotiation.cc:240] Negotiation successful
0806 19:32:15.181480 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":368,"threads_started":1}
I20260806 19:32:15.184962 9235 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:32:15.185333 9235 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:15.186229 9235 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:32:15.188081 8747 ts_manager.cc:194] Registered new tserver with Master: e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871)
I20260806 19:32:15.189265 8747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:54387
W20260806 19:32:15.541631 9239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:15.541975 9239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:15.542083 9239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:15.549687 9239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:15.549814 9239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:15.549935 9239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:32:15.560336 9239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:44827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=42543
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:15.561748 9239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:15.563097 9239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:15.577019 9249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:15.577019 9251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:15.577222 9248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:15.577852 9239 server_base.cc:1034] running on GCE node
I20260806 19:32:15.578557 9239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:15.579646 9239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:15.580879 9239 hybrid_clock.cc:648] HybridClock initialized: now 1786044735580817 us; error 58 us; skew 500 ppm
I20260806 19:32:15.581238 9239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:15 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044735, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:15.584649 9239 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:32:15.586359 9239 webserver.cc:460] Webserver started at http://127.17.18.67:42543/ using document root <none> and password file <none>
I20260806 19:32:15.587076 9239 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:15.587217 9239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:15.593343 9239 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 19:32:15.596535 9263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.598112 9239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 19:32:15.598353 9239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "51615d22d8284d6bb784a3d5cd906d9c"
format_stamp: "Formatted at 2026-08-06 19:31:52 on dist-test-slave-f0tn"
server_key: "7542bd12185aa875330f63879a3160fc"
server_key_iv: "8a168744a471ce704998880319032a4c"
server_key_version: "encryptionkey@0"
I20260806 19:32:15.599455 9239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:15.621985 9239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:15.626677 9239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:15.626979 9239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:15.628074 9239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:15.629676 9239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:15.629784 9239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.629900 9239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:15.629973 9239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:15.662943 9239 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44827
I20260806 19:32:15.663007 9427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44827 every 8 connection(s)
I20260806 19:32:15.664659 9239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:32:15.671849 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 9239
Aug 06 19:32:15 dist-test-slave-f0tn krb5kdc[7859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044735, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:15.688660 9041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.667382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:40987 (local address 127.17.18.126:45293)
0806 19:32:15.667561 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.667566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.668847 (+ 1281us) server_negotiation.cc:407] Connection header received
0806 19:32:15.670926 (+ 2079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.670932 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.671022 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.671117 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:15.673465 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.674434 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.676890 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.677637 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.677786 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.682042 (+ 4256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:15.682048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:15.682051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:15.682086 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:15.685266 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.686102 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.686108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.686112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.686267 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.686700 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.686706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.686708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.687036 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:15.687212 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.688004 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.688250 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 19:32:15.689605 9433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.673035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38146 (local address 127.17.18.126:45293)
0806 19:32:15.673593 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.673599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.673959 (+ 360us) server_negotiation.cc:407] Connection header received
0806 19:32:15.674100 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.674106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.674191 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.674298 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:15.676611 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.677761 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.679656 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.680084 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.680220 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.683455 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:15.683460 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:15.683463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:15.683511 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:15.686700 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.687458 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.687463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.687465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.687594 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.687995 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.687998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.688001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.688277 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:15.688529 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.688866 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.689084 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":427,"thread_start_us":270,"threads_started":1}
I20260806 19:32:15.690023 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.667862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:40987)
0806 19:32:15.668658 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:15.668708 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:15.670589 (+ 1881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:15.671483 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:15.671497 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:15.672375 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:15.673177 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.673205 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.674632 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.674638 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.676726 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.676742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.677909 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.677918 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.678266 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.679076 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:15.679115 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:15.681797 (+ 2682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:15.685448 (+ 3651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:15.685460 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:15.685482 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:15.685970 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:15.686375 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:15.686378 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:15.686380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:15.686584 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:15.687187 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:15.687196 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:15.687621 (+ 425us) client_negotiation.cc:769] Sending connection context
0806 19:32:15.687890 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 19:32:15.688503 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":308,"threads_started":1}
I20260806 19:32:15.690448 9039 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
I20260806 19:32:15.692287 9428 heartbeater.cc:347] Connected to a master server at 127.17.18.126:45293
I20260806 19:32:15.692647 9428 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:15.693471 9428 heartbeater.cc:511] Master 127.17.18.126:45293 requested a full tablet report, sending...
I20260806 19:32:15.694932 8747 ts_manager.cc:194] Registered new tserver with Master: 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827)
I20260806 19:32:15.695798 8747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:40987
I20260806 19:32:15.705581 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:32:15.712714 9433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.706582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38154 (local address 127.17.18.126:45293)
0806 19:32:15.706785 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.706790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.707216 (+ 426us) server_negotiation.cc:407] Connection header received
0806 19:32:15.707432 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.707437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.707604 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.707765 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:32:15.708213 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.709045 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.710632 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.711159 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.711275 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.711821 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:32:15.712162 (+ 341us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 19:32:15.712495 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38154: token expired
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 19:32:15.712838 9433 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38154: token expired
W20260806 19:32:15.713522 8626 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.18.126:45293)
I20260806 19:32:15.726667 9433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.714085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38164 (local address 127.17.18.126:45293)
0806 19:32:15.714237 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.714241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.714285 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:32:15.714413 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.714417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.714481 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.714559 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:15.715902 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.716688 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.718079 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.718527 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.718624 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.721310 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:15.721315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:15.721318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:15.721356 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:15.724051 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.724761 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.724766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.724768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.724910 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:15.725244 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:15.725247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:15.725249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:15.725637 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:15.725841 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.726222 (+ 381us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.726420 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 19:32:15.730438 8747 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:32:15.738185 8747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:32:15.764499 9441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.750929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:32871 (local address 127.0.0.1:48748)
0806 19:32:15.751981 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:15.752050 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:15.752252 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:15.754517 (+ 2265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:15.754524 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:15.754554 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:15.755025 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.755041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.757341 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.757348 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.760384 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.760411 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.763269 (+ 2858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.763276 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.763525 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.763595 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 19:32:15.763759 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 19:32:15.764027 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":386,"threads_started":1}
I20260806 19:32:15.765830 9442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.751079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48748 (local address 127.17.18.66:32871)
0806 19:32:15.753452 (+ 2373us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.753461 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.753492 (+ 31us) server_negotiation.cc:407] Connection header received
0806 19:32:15.753600 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.753607 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.754015 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.754243 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:15.755368 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.757125 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.760683 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.762640 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.762804 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.763053 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.765148 (+ 2095us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.765433 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2146,"thread_start_us":1779,"threads_started":1}
I20260806 19:32:15.770820 9133 tablet_service.cc:1467] Processing CreateTablet for tablet 620f731056014aa9bd80dbe5a6fc259c (DEFAULT_TABLE table=test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:15.772727 9133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620f731056014aa9bd80dbe5a6fc259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:15.774176 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.752456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.17.18.65:42429)
0806 19:32:15.765162 (+ 12706us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.765174 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.765213 (+ 39us) server_negotiation.cc:407] Connection header received
0806 19:32:15.765352 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.765362 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.765748 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.767659 (+ 1911us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:15.767948 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.769502 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.771626 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.772846 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.773284 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.773582 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.773661 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.773856 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12477,"thread_start_us":13925,"threads_started":1}
I20260806 19:32:15.774911 9443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.752203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42429 (local address 127.0.0.1:49150)
0806 19:32:15.752802 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:15.752819 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:15.752948 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:15.766945 (+ 13997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:15.766950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:15.766984 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:15.767420 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.767436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.769639 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.769644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.771444 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.771461 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.773132 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.773138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.773409 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.773447 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 19:32:15.773540 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 19:32:15.773694 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":46,"thread_start_us":310,"threads_started":1}
I20260806 19:32:15.776626 9446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.753202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:44827 (local address 127.0.0.1:37824)
0806 19:32:15.766420 (+ 13218us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:15.766442 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:15.766579 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:15.768668 (+ 2089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:15.768673 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:15.768703 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:15.769129 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.769144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.771282 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.771291 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.773361 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:15.773399 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.775717 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.775724 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:15.775912 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.775950 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 19:32:15.776063 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 19:32:15.776233 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13072,"mutex_wait_us":1,"thread_start_us":12904,"threads_started":1}
I20260806 19:32:15.776706 9448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:15.753351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37824 (local address 127.17.18.67:44827)
0806 19:32:15.767338 (+ 13987us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:15.767347 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:15.767388 (+ 41us) server_negotiation.cc:407] Connection header received
0806 19:32:15.767830 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:15.767839 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:15.768125 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:15.768354 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:15.769412 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.771081 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.773616 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:15.775127 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:15.775301 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:15.775551 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:15.776159 (+ 608us) server_negotiation.cc:299] Negotiation successful
0806 19:32:15.776354 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13778,"thread_start_us":13529,"threads_started":1}
I20260806 19:32:15.779201 8938 tablet_service.cc:1467] Processing CreateTablet for tablet 620f731056014aa9bd80dbe5a6fc259c (DEFAULT_TABLE table=test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:15.780653 8938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620f731056014aa9bd80dbe5a6fc259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:15.781761 9333 tablet_service.cc:1467] Processing CreateTablet for tablet 620f731056014aa9bd80dbe5a6fc259c (DEFAULT_TABLE table=test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:15.783406 9333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 620f731056014aa9bd80dbe5a6fc259c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:15.789870 9449 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Bootstrap starting.
I20260806 19:32:15.794123 9449 tablet_bootstrap.cc:654] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:15.795778 9449 log.cc:824] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:15.796200 9450 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Bootstrap starting.
I20260806 19:32:15.799788 9449 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: No bootstrap required, opened a new log
I20260806 19:32:15.800139 9449 ts_tablet_manager.cc:1397] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 19:32:15.800547 9453 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Bootstrap starting.
I20260806 19:32:15.800848 9450 tablet_bootstrap.cc:654] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:15.803014 9450 log.cc:824] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:15.804517 9453 tablet_bootstrap.cc:654] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:15.805974 9453 log.cc:824] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:15.806308 9450 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: No bootstrap required, opened a new log
I20260806 19:32:15.806617 9450 ts_tablet_manager.cc:1397] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 19:32:15.809787 9453 tablet_bootstrap.cc:492] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: No bootstrap required, opened a new log
I20260806 19:32:15.810124 9453 ts_tablet_manager.cc:1397] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260806 19:32:15.811304 9449 raft_consensus.cc:348] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.811856 9449 raft_consensus.cc:374] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:15.811968 9449 raft_consensus.cc:729] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b5943b6ff74c51acb534be843d1ffc, State: Initialized, Role: FOLLOWER
I20260806 19:32:15.812698 9449 consensus_queue.cc:260] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.814072 9235 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
I20260806 19:32:15.814812 9449 ts_tablet_manager.cc:1428] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260806 19:32:15.815320 9450 raft_consensus.cc:348] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.815835 9450 raft_consensus.cc:374] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:15.815943 9450 raft_consensus.cc:729] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ea989f3bf78454da930934fb21a41f8, State: Initialized, Role: FOLLOWER
I20260806 19:32:15.816661 9450 consensus_queue.cc:260] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.819851 9450 ts_tablet_manager.cc:1428] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260806 19:32:15.822351 9453 raft_consensus.cc:348] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.822827 9453 raft_consensus.cc:374] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:15.822935 9453 raft_consensus.cc:729] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51615d22d8284d6bb784a3d5cd906d9c, State: Initialized, Role: FOLLOWER
I20260806 19:32:15.823665 9453 consensus_queue.cc:260] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:15.824815 9428 heartbeater.cc:503] Master 127.17.18.126:45293 was elected leader, sending a full tablet report...
I20260806 19:32:15.825330 9453 ts_tablet_manager.cc:1428] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260806 19:32:15.902155 9040 tablet.cc:2369] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:32:15.909480 9236 tablet.cc:2369] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:32:15.916416 9430 tablet.cc:2369] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:32:16.230443 9459 raft_consensus.cc:482] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:32:16.230857 9459 raft_consensus.cc:504] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:16.232650 9459 leader_election.cc:288] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871), 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429)
I20260806 19:32:16.239499 9442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.233264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:43441 (local address 127.17.18.66:32871)
0806 19:32:16.233542 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.233550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.234275 (+ 725us) server_negotiation.cc:407] Connection header received
0806 19:32:16.234369 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.234374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.234454 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.234545 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:16.235164 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.235898 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.237732 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.238554 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.238713 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.238792 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.239069 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.239237 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 19:32:16.239583 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.233079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:32871 (local address 127.17.18.67:43441)
0806 19:32:16.233809 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:16.233828 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:16.234089 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:16.234580 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:16.234585 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:16.234620 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:16.234997 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:16.235007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.236042 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.236048 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:16.237549 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:16.237565 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.238721 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.238727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:16.238904 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.238930 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 19:32:16.239015 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 19:32:16.239156 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":364,"threads_started":1}
I20260806 19:32:16.240208 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.234054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:42429 (local address 127.17.18.67:39453)
0806 19:32:16.234806 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:16.234821 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:16.234969 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:16.235280 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:16.235284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:16.235308 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:16.235690 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:16.235700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.236720 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.236724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:16.238262 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:16.238276 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.239450 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.239457 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:16.239618 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.239651 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 19:32:16.239796 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 19:32:16.239923 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":428,"threads_started":1}
I20260806 19:32:16.240267 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.234249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:39453 (local address 127.17.18.65:42429)
0806 19:32:16.234453 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.234459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.234920 (+ 461us) server_negotiation.cc:407] Connection header received
0806 19:32:16.235100 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.235105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.235174 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.235249 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:16.235850 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.236577 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.238421 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.239237 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.239386 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.239458 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.239861 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.240010 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 19:32:16.240882 9169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620f731056014aa9bd80dbe5a6fc259c" candidate_uuid: "51615d22d8284d6bb784a3d5cd906d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b5943b6ff74c51acb534be843d1ffc" is_pre_election: true
I20260806 19:32:16.241598 9169 raft_consensus.cc:2454] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51615d22d8284d6bb784a3d5cd906d9c in term 0.
I20260806 19:32:16.241508 8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620f731056014aa9bd80dbe5a6fc259c" candidate_uuid: "51615d22d8284d6bb784a3d5cd906d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ea989f3bf78454da930934fb21a41f8" is_pre_election: true
I20260806 19:32:16.242131 8971 raft_consensus.cc:2454] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51615d22d8284d6bb784a3d5cd906d9c in term 0.
I20260806 19:32:16.242440 9268 leader_election.cc:302] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51615d22d8284d6bb784a3d5cd906d9c, e8b5943b6ff74c51acb534be843d1ffc; no voters:
I20260806 19:32:16.242861 9459 raft_consensus.cc:2781] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:32:16.242997 9459 raft_consensus.cc:482] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:32:16.243099 9459 raft_consensus.cc:3037] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:16.245503 9459 raft_consensus.cc:504] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:16.246191 9459 leader_election.cc:288] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [CANDIDATE]: Term 1 election: Requested vote from peers e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871), 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429)
I20260806 19:32:16.246790 9169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620f731056014aa9bd80dbe5a6fc259c" candidate_uuid: "51615d22d8284d6bb784a3d5cd906d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b5943b6ff74c51acb534be843d1ffc"
I20260806 19:32:16.246863 8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "620f731056014aa9bd80dbe5a6fc259c" candidate_uuid: "51615d22d8284d6bb784a3d5cd906d9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ea989f3bf78454da930934fb21a41f8"
I20260806 19:32:16.246999 9169 raft_consensus.cc:3037] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:16.247108 8971 raft_consensus.cc:3037] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:16.249476 8971 raft_consensus.cc:2454] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51615d22d8284d6bb784a3d5cd906d9c in term 1.
I20260806 19:32:16.249735 9169 raft_consensus.cc:2454] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51615d22d8284d6bb784a3d5cd906d9c in term 1.
I20260806 19:32:16.249959 9268 leader_election.cc:302] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51615d22d8284d6bb784a3d5cd906d9c, 5ea989f3bf78454da930934fb21a41f8; no voters:
I20260806 19:32:16.250288 9459 raft_consensus.cc:2781] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:32:16.250751 9459 raft_consensus.cc:686] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 1 LEADER]: Becoming Leader. State: Replica: 51615d22d8284d6bb784a3d5cd906d9c, State: Running, Role: LEADER
I20260806 19:32:16.251330 9459 consensus_queue.cc:237] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } }
I20260806 19:32:16.256614 8747 catalog_manager.cc:5495] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67). New cstate: current_term: 1 leader_uuid: "51615d22d8284d6bb784a3d5cd906d9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51615d22d8284d6bb784a3d5cd906d9c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 44827 } health_report { overall_health: HEALTHY } } }
I20260806 19:32:16.335829 9476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.329293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37826 (local address 127.17.18.67:44827)
0806 19:32:16.329811 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.329816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.329934 (+ 118us) server_negotiation.cc:407] Connection header received
0806 19:32:16.330123 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.330127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.330222 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.330382 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:32:16.330916 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.331665 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.333409 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.333892 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.334011 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.334668 (+ 657us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:32:16.335247 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:32:16.335379 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.335507 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.335590 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":290,"threads_started":1}
I20260806 19:32:16.344913 9169 raft_consensus.cc:1261] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Refusing update from remote peer 51615d22d8284d6bb784a3d5cd906d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:32:16.344913 8971 raft_consensus.cc:1261] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Refusing update from remote peer 51615d22d8284d6bb784a3d5cd906d9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:32:16.346163 9462 consensus_queue.cc:1035] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b5943b6ff74c51acb534be843d1ffc" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 32871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:32:16.346652 9459 consensus_queue.cc:1035] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ea989f3bf78454da930934fb21a41f8" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 42429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:32:16.360438 9478 mvcc.cc:205] Tried to move back new op lower bound from 7315639240056844288 to 7315639239689875456. Current Snapshot: MvccSnapshot[applied={T|T < 7315639240056844288}]
I20260806 19:32:16.376025 8747 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:32:16.376323 8747 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38164:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:32:16.380061 8747 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Sending DeleteTablet for 3 replicas of tablet 620f731056014aa9bd80dbe5a6fc259c
I20260806 19:32:16.381498 9133 tablet_service.cc:1514] Processing DeleteTablet for tablet 620f731056014aa9bd80dbe5a6fc259c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:16 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:48748
I20260806 19:32:16.381485 9333 tablet_service.cc:1514] Processing DeleteTablet for tablet 620f731056014aa9bd80dbe5a6fc259c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:16 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:37824
I20260806 19:32:16.381564 8938 tablet_service.cc:1514] Processing DeleteTablet for tablet 620f731056014aa9bd80dbe5a6fc259c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:16 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:49150
I20260806 19:32:16.382920 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 8800
I20260806 19:32:16.391671 9499 tablet_replica.cc:330] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: stopping tablet replica
I20260806 19:32:16.392417 9499 raft_consensus.cc:2229] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:32:16.393138 9499 raft_consensus.cc:2258] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:16.394163 9498 tablet_replica.cc:330] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: stopping tablet replica
I20260806 19:32:16.395925 9499 ts_tablet_manager.cc:1905] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:16.396517 9498 raft_consensus.cc:2229] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:32:16.397117 9498 raft_consensus.cc:2258] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:16.400648 9498 ts_tablet_manager.cc:1905] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:16.404007 9496 tablet_replica.cc:330] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: stopping tablet replica
I20260806 19:32:16.404654 9496 raft_consensus.cc:2229] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:32:16.405556 9496 raft_consensus.cc:2258] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:16.407863 9496 ts_tablet_manager.cc:1905] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:16.411639 9498 ts_tablet_manager.cc:1918] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:16.411875 9498 log.cc:1196] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/620f731056014aa9bd80dbe5a6fc259c
I20260806 19:32:16.412492 9498 ts_tablet_manager.cc:1939] T 620f731056014aa9bd80dbe5a6fc259c P e8b5943b6ff74c51acb534be843d1ffc: Deleting consensus metadata
I20260806 19:32:16.414865 8725 catalog_manager.cc:4841] TS e8b5943b6ff74c51acb534be843d1ffc (127.17.18.66:32871): tablet 620f731056014aa9bd80dbe5a6fc259c (table test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]) successfully deleted
I20260806 19:32:16.415084 9499 ts_tablet_manager.cc:1918] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:16.415284 9499 log.cc:1196] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/620f731056014aa9bd80dbe5a6fc259c
I20260806 19:32:16.415861 9499 ts_tablet_manager.cc:1939] T 620f731056014aa9bd80dbe5a6fc259c P 5ea989f3bf78454da930934fb21a41f8: Deleting consensus metadata
I20260806 19:32:16.417896 8725 catalog_manager.cc:4841] TS 5ea989f3bf78454da930934fb21a41f8 (127.17.18.65:42429): tablet 620f731056014aa9bd80dbe5a6fc259c (table test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]) successfully deleted
I20260806 19:32:16.420184 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.384355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49152 (local address 127.17.18.65:42429)
0806 19:32:16.384556 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.384562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.400448 (+ 15886us) server_negotiation.cc:407] Connection header received
0806 19:32:16.400996 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.401008 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.401124 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.401219 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:16.403807 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.404856 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.407062 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.407706 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.407821 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.412107 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:16.412132 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:16.412153 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:16.412228 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:16.416348 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.417452 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.417463 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.417467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.417651 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.418167 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.418172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.418174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.418632 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:16.418865 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.419521 (+ 656us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.419766 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 19:32:16.420949 9026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:16.421402 9496 ts_tablet_manager.cc:1918] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:16.421617 9496 log.cc:1196] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/620f731056014aa9bd80dbe5a6fc259c
I20260806 19:32:16.422312 9496 ts_tablet_manager.cc:1939] T 620f731056014aa9bd80dbe5a6fc259c P 51615d22d8284d6bb784a3d5cd906d9c: Deleting consensus metadata
I20260806 19:32:16.424489 8727 catalog_manager.cc:4841] TS 51615d22d8284d6bb784a3d5cd906d9c (127.17.18.67:44827): tablet 620f731056014aa9bd80dbe5a6fc259c (table test-table [id=e2d7a5abe4364a088bfe2efb4969f1de]) successfully deleted
I20260806 19:32:16.520737 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 8800
I20260806 19:32:16.551988 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 9044
I20260806 19:32:16.575824 9442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.552890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.17.18.66:32871)
0806 19:32:16.553073 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.553079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.553171 (+ 92us) server_negotiation.cc:407] Connection header received
0806 19:32:16.553429 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.553435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.553672 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.553790 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:16.555303 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.556038 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.557478 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.557953 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.558081 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.568951 (+ 10870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:16.568973 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:16.568993 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:16.569045 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:16.572133 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.573150 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.573164 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.573167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.573423 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.573939 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.573945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.573948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.574539 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:16.574867 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.575168 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.575449 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:32:16.576735 9226 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:16.669988 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 9044
I20260806 19:32:16.702250 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 9239
I20260806 19:32:16.717869 9476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:16.703097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37834 (local address 127.17.18.67:44827)
0806 19:32:16.703348 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:16.703357 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:16.703379 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:32:16.703522 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:16.703528 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:16.703615 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:16.703740 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:16.705190 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.706262 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.707681 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:16.708155 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:16.708272 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:16.711103 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:16.711119 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:16.711138 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:16.711189 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:16.714656 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.715490 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.715498 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.715501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.715673 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:16.716083 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:16.716088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:16.716090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:16.716495 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:16.716874 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:16.717158 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 19:32:16.717487 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 19:32:16.718717 9423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:16.847865 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 9239
I20260806 19:32:16.874752 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 8693
I20260806 19:32:16.876060 8788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:16.994725 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 8693
I20260806 19:32:37.023222 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--webserver_interface=127.17.18.126
--webserver_port=34863
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:32:37.411612 9506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:37.411938 9506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:37.412055 9506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:37.419718 9506 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 19:32:37.419842 9506 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 19:32:37.419883 9506 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 19:32:37.419927 9506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:32:37.419983 9506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:37.420063 9506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:37.420110 9506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:32:37.420164 9506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:32:37.430771 9506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=34863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:37.432256 9506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:37.433732 9506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:37.446941 9514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:37.447150 9512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:37.447403 9517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:37.447805 9506 server_base.cc:1034] running on GCE node
I20260806 19:32:37.448669 9506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:37.450333 9506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:37.451581 9506 hybrid_clock.cc:648] HybridClock initialized: now 1786044757451487 us; error 65 us; skew 500 ppm
I20260806 19:32:37.451977 9506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:37 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044757, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:37.461288 9506 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:32:37.463081 9506 webserver.cc:460] Webserver started at http://127.17.18.126:34863/ using document root <none> and password file <none>
I20260806 19:32:37.463856 9506 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:37.463959 9506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:37.470085 9506 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:32:37.473345 9528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:37.475046 9506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:32:37.475271 9506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "c6e25c840caa4fa68bc37570492e6e4e"
format_stamp: "Formatted at 2026-08-06 19:31:50 on dist-test-slave-f0tn"
server_key: "be5717773733883b9a09f188bf42dcb3"
server_key_iv: "4dcffe8e576ebc45b98fac551503bc4e"
server_key_version: "encryptionkey@0"
I20260806 19:32:37.476387 9506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:37.517571 9506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:37.522526 9506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:37.522854 9506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:37.542126 9506 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45293
I20260806 19:32:37.542151 9611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45293 every 8 connection(s)
I20260806 19:32:37.543852 9506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:32:37.551716 9617 sys_catalog.cc:263] Verifying existing consensus state
I20260806 19:32:37.553820 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 9506
I20260806 19:32:37.554781 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:42429
--local_ip_for_outbound_sockets=127.17.18.65
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=35683
--webserver_interface=127.17.18.65
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:32:37.555912 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap starting.
I20260806 19:32:37.578907 9617 log.cc:824] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:37.596872 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 19:32:37.597548 9617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Bootstrap complete.
I20260806 19:32:37.607095 9617 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:37.608086 9617 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Initialized, Role: FOLLOWER
I20260806 19:32:37.608765 9617 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:37.609014 9617 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:32:37.609145 9617 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:32:37.609319 9617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 2 FOLLOWER]: Advancing to term 3
I20260806 19:32:37.613618 9617 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:37.614193 9617 leader_election.cc:302] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6e25c840caa4fa68bc37570492e6e4e; no voters:
I20260806 19:32:37.614935 9617 leader_election.cc:288] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 19:32:37.615118 9622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 3 FOLLOWER]: Leader election won for term 3
I20260806 19:32:37.616252 9622 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [term 3 LEADER]: Becoming Leader. State: Replica: c6e25c840caa4fa68bc37570492e6e4e, State: Running, Role: LEADER
I20260806 19:32:37.616956 9622 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } }
I20260806 19:32:37.617327 9617 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:32:37.619773 9623 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:32:37.620209 9623 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:37.622478 9624 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e25c840caa4fa68bc37570492e6e4e. Latest consensus state: current_term: 3 leader_uuid: "c6e25c840caa4fa68bc37570492e6e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e25c840caa4fa68bc37570492e6e4e" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45293 } } }
I20260806 19:32:37.622816 9624 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:37.624104 9627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:32:37.633446 9627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:32:37.635316 9627 catalog_manager.cc:1259] Loaded cluster ID: 8432dee565d64c839c1ca60289dd941b
I20260806 19:32:37.635840 9627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:32:37.640381 9627 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:32:37.642678 9627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Loaded TSK: 0
I20260806 19:32:37.642997 9627 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c6e25c840caa4fa68bc37570492e6e4e: Loaded TSK: 1
F20260806 19:32:37.644374 9627 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f299910a9ad google::LogMessage::Fail() at ??:0
@ 0x7f299910d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f299910a4de google::LogMessage::Flush() at ??:0
@ 0x7f299910ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f299ce6e7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f299ce5d73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f29aeb391c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f29aeb38783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
I20260806 19:32:37.696574 9652 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f29aebc42a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f29aebc40c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f29aec0e5e9 std::function<>::operator()() at ??:0
@ 0x7f29aeb3ccdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f29aeb3ac36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f29aebc2610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f29aebc2439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f299bd56345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f299bd5991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f299bd59799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f299bd34eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f299f00e6db start_thread at ??:0
@ 0x7f2997fa461f clone at ??:0
W20260806 19:32:38.000602 9620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:38.000943 9620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:38.001070 9620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:38.008896 9620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:38.009043 9620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:38.009166 9620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:32:38.019649 9620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:42429
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=35683
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:38.021080 9620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:38.023181 9620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:38.038200 9684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:38.038093 9688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:38.038058 9685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:38.039407 9620 server_base.cc:1034] running on GCE node
I20260806 19:32:38.040138 9620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:38.041253 9620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:38.042495 9620 hybrid_clock.cc:648] HybridClock initialized: now 1786044758042441 us; error 73 us; skew 500 ppm
I20260806 19:32:38.042862 9620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:38 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:38.046303 9620 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:32:38.048295 9620 webserver.cc:460] Webserver started at http://127.17.18.65:35683/ using document root <none> and password file <none>
I20260806 19:32:38.049113 9620 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:38.049242 9620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:38.055583 9620 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:32:38.058848 9695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:38.060534 9620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:32:38.060739 9620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "5ea989f3bf78454da930934fb21a41f8"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "6a71c9f471086ee613802f555f6ba4aa"
server_key_iv: "b482c173f6ff86133862758c3ec29c88"
server_key_version: "encryptionkey@0"
I20260806 19:32:38.061941 9620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:38.077616 9620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:38.082340 9620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:38.082650 9620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:38.083768 9620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:38.085304 9620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:38.085433 9620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 19:32:38.085551 9620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:38.085637 9620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:38.121407 9620 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:42429
I20260806 19:32:38.121513 9866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:42429 every 8 connection(s)
I20260806 19:32:38.123131 9620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:32:38.123946 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 9620
I20260806 19:32:38.124848 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:32871
--local_ip_for_outbound_sockets=127.17.18.66
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=36981
--webserver_interface=127.17.18.66
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:32:38.130097 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.127029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:46225)
0806 19:32:38.128088 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.128647 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":406,"threads_started":1}
W20260806 19:32:38.131059 9867 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:45293 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:45293: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
I20260806 19:32:38.132344 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.131820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:58665)
0806 19:32:38.132069 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.132176 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 19:32:38.133584 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.133141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:59243)
0806 19:32:38.133308 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.133431 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 19:32:38.133991 9867 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:32:38.529832 9875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:38.530185 9875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:38.530305 9875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:38.538520 9875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:38.538673 9875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:38.538796 9875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:32:38.549492 9875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:32871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=36981
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:38.550917 9875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:38.552529 9875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:38.568488 9884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:38.568488 9890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:38.568518 9883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:38.570158 9875 server_base.cc:1034] running on GCE node
I20260806 19:32:38.570966 9875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:38.572322 9875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:38.573541 9875 hybrid_clock.cc:648] HybridClock initialized: now 1786044758573478 us; error 42 us; skew 500 ppm
I20260806 19:32:38.574090 9875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:38 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:38.579041 9875 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:32:38.586114 9875 webserver.cc:460] Webserver started at http://127.17.18.66:36981/ using document root <none> and password file <none>
I20260806 19:32:38.587523 9875 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:38.587740 9875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:38.595685 9875 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 19:32:38.601238 9898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:38.603531 9875 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 19:32:38.603819 9875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "e8b5943b6ff74c51acb534be843d1ffc"
format_stamp: "Formatted at 2026-08-06 19:31:51 on dist-test-slave-f0tn"
server_key: "c9f4ac98ce03a29271cf3b9dbf2f8288"
server_key_iv: "b80b273c44a830d1ec2eeed6464cdac6"
server_key_version: "encryptionkey@0"
I20260806 19:32:38.605082 9875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:38.632891 9875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:38.640581 9875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:38.640925 9875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:38.642539 9875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:38.644984 9875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:38.645180 9875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:38.645323 9875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:38.645504 9875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:38.689416 9875 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:32871
I20260806 19:32:38.689522 10049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:32871 every 8 connection(s)
I20260806 19:32:38.691359 9875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:32:38.694964 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 9875
I20260806 19:32:38.695765 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:44827
--local_ip_for_outbound_sockets=127.17.18.67
--tserver_master_addrs=127.17.18.126:45293
--webserver_port=42543
--webserver_interface=127.17.18.67
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:32:38.697886 10053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.695360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:35655)
0806 19:32:38.696350 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.696714 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":405,"threads_started":1}
W20260806 19:32:38.698815 10050 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:45293 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:45293: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
I20260806 19:32:38.699870 10053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.699456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:47663)
0806 19:32:38.699641 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.699736 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:32:38.701860 10053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:38.701327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:46009)
0806 19:32:38.701525 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:38.701643 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260806 19:32:38.705783 10050 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 19:32:39.120688 10055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:39.121093 10055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:39.121243 10055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:39.129745 10055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:39.129894 10055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:39.130059 10055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:32:39.135973 10062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:39.134797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:59687)
0806 19:32:39.135464 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:39.135599 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":277,"threads_started":1}
I20260806 19:32:39.141753 10055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:44827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=42543
--tserver_master_addrs=127.17.18.126:45293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:39.143262 10055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:39.145059 10055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:39.161520 10065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:39.161442 10072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:39.161478 10068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:39.163386 10055 server_base.cc:1034] running on GCE node
I20260806 19:32:39.164316 10055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:39.165750 10055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:39.167172 10055 hybrid_clock.cc:648] HybridClock initialized: now 1786044759167000 us; error 97 us; skew 500 ppm
I20260806 19:32:39.167629 10055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:39 dist-test-slave-f0tn krb5kdc[7859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044759, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:39.173704 10055 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:32:39.176257 10055 webserver.cc:460] Webserver started at http://127.17.18.67:42543/ using document root <none> and password file <none>
I20260806 19:32:39.177364 10055 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:39.177587 10055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:39.185807 10055 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:32:39.189515 10083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:39.191453 10055 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:32:39.191668 10055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "51615d22d8284d6bb784a3d5cd906d9c"
format_stamp: "Formatted at 2026-08-06 19:31:52 on dist-test-slave-f0tn"
server_key: "7542bd12185aa875330f63879a3160fc"
server_key_iv: "8a168744a471ce704998880319032a4c"
server_key_version: "encryptionkey@0"
I20260806 19:32:39.192818 10055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:39.229116 10055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:39.234280 10055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:39.234581 10055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:39.235981 10055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:39.237679 10055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:39.237808 10055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:39.237897 10055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:39.237953 10055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:39.279469 10055 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:44827
I20260806 19:32:39.279527 10248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:44827 every 8 connection(s)
I20260806 19:32:39.281124 10055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:32:39.287127 10253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:39.284767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:52131)
0806 19:32:39.285799 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:39.286104 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":431,"threads_started":1}
W20260806 19:32:39.288223 10250 heartbeater.cc:644] Failed to heartbeat to 127.17.18.126:45293 (0 consecutive failures): Network error: Failed to ping master at 127.17.18.126:45293: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
I20260806 19:32:39.288341 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 10055
I20260806 19:32:39.289418 10253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:39.288947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:44387)
0806 19:32:39.289140 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:39.289226 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 19:32:39.290453 10253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:39.290041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:38223)
0806 19:32:39.290198 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:39.290289 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 19:32:39.290745 10250 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 19:32:39.707449 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:39.706531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:48145)
0806 19:32:39.707092 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:39.707196 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":280,"threads_started":1}
I20260806 19:32:40.138183 10261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:40.137231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:39099)
0806 19:32:40.137858 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:40.137961 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":341,"threads_started":1}
I20260806 19:32:40.292551 10262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:40.291575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:57261)
0806 19:32:40.292189 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:40.292291 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":327,"threads_started":1}
I20260806 19:32:40.709910 10263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:40.708781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:40551)
0806 19:32:40.709496 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:40.709705 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":406,"threads_started":1}
I20260806 19:32:41.140403 10264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:41.139480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:46883)
0806 19:32:41.140092 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:41.140208 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":349,"threads_started":1}
I20260806 19:32:41.294767 10265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:41.293899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:41633)
0806 19:32:41.294445 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:41.294549 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":269,"threads_started":1}
I20260806 19:32:41.711994 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:41.711078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:59701)
0806 19:32:41.711643 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:41.711753 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":277,"threads_started":1}
I20260806 19:32:42.142484 10267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:42.141593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:57787)
0806 19:32:42.142184 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:42.142289 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":264,"threads_started":1}
I20260806 19:32:42.296475 10268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:42.295721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:40017)
0806 19:32:42.296199 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:42.296289 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":247,"threads_started":1}
I20260806 19:32:42.714037 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:42.713168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:56245)
0806 19:32:42.713760 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:42.713854 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":311,"threads_started":1}
I20260806 19:32:43.144542 10270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:43.143666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:51357)
0806 19:32:43.144267 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:43.144355 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":325,"threads_started":1}
I20260806 19:32:43.298590 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:43.297706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:52001)
0806 19:32:43.298295 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:43.298395 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":295,"threads_started":1}
I20260806 19:32:43.716151 10275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:43.715209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:37337)
0806 19:32:43.715793 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:43.715895 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":300,"threads_started":1}
I20260806 19:32:44.146592 10277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:44.145651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:44203)
0806 19:32:44.146261 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:44.146373 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":307,"threads_started":1}
I20260806 19:32:44.300382 10278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:44.299583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:33205)
0806 19:32:44.300081 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:44.300173 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":261,"threads_started":1}
I20260806 19:32:44.718237 10280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:44.717271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:45319)
0806 19:32:44.717939 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:44.718048 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":446,"threads_started":1}
I20260806 19:32:45.148550 10283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:45.147648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:33299)
0806 19:32:45.148219 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:45.148311 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":253,"threads_started":1}
I20260806 19:32:45.302354 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:45.301503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:42455)
0806 19:32:45.302062 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:45.302183 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":288,"threads_started":1}
I20260806 19:32:45.720373 10286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:45.719467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:43979)
0806 19:32:45.720047 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:45.720139 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":257,"threads_started":1}
I20260806 19:32:46.151141 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:46.149781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:52503)
0806 19:32:46.150608 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:46.150873 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":511,"threads_started":1}
I20260806 19:32:46.304505 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:46.303568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:33333)
0806 19:32:46.304179 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:46.304270 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":291,"threads_started":1}
I20260806 19:32:46.722426 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:46.721604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:54333)
0806 19:32:46.722136 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:46.722239 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":279,"threads_started":1}
I20260806 19:32:47.153131 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:47.152259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:59489)
0806 19:32:47.152843 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:47.152935 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":289,"threads_started":1}
I20260806 19:32:47.306349 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:47.305524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:53263)
0806 19:32:47.306062 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:47.306158 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":261,"threads_started":1}
I20260806 19:32:47.724274 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:47.723403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:50699)
0806 19:32:47.723950 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:47.724043 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":267,"threads_started":1}
I20260806 19:32:48.155228 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:48.154371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:40199)
0806 19:32:48.154935 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:48.155032 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":311,"threads_started":1}
I20260806 19:32:48.308378 10297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:48.307443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:35261)
0806 19:32:48.308028 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:48.308167 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":296,"threads_started":1}
I20260806 19:32:48.726290 10298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:48.725492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:33897)
0806 19:32:48.726010 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:48.726104 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":279,"threads_started":1}
I20260806 19:32:49.157039 10299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:49.156264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:36607)
0806 19:32:49.156733 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:49.156834 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":227,"threads_started":1}
I20260806 19:32:49.310534 10300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:49.309656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:45635)
0806 19:32:49.310243 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:49.310345 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":267,"threads_started":1}
I20260806 19:32:49.728368 10301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:49.727430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:40863)
0806 19:32:49.728061 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:49.728173 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":310,"threads_started":1}
I20260806 19:32:50.159278 10302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:50.158290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:34691)
0806 19:32:50.158875 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:50.158980 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":386,"threads_started":1}
I20260806 19:32:50.312418 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:50.311615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:51205)
0806 19:32:50.312110 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:50.312223 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":234,"threads_started":1}
I20260806 19:32:50.730372 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:50.729503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:59807)
0806 19:32:50.730110 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:50.730202 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":360,"threads_started":1}
I20260806 19:32:51.161532 10305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:51.160454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:45843)
0806 19:32:51.161159 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:51.161275 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":393,"threads_started":1}
I20260806 19:32:51.314254 10306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:51.313526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:39735)
0806 19:32:51.313996 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:51.314082 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":234,"threads_started":1}
I20260806 19:32:51.732434 10307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:51.731491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:43681)
0806 19:32:51.732098 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:51.732219 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":323,"threads_started":1}
I20260806 19:32:52.163743 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:52.162851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:41517)
0806 19:32:52.163427 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:52.163530 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":285,"threads_started":1}
I20260806 19:32:52.316325 10314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:52.315384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:45451)
0806 19:32:52.315993 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:52.316111 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":293,"threads_started":1}
I20260806 19:32:52.734419 10316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:52.733511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:32951)
0806 19:32:52.734073 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:52.734178 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":307,"threads_started":1}
I20260806 19:32:53.166345 10317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:53.165186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:35897)
0806 19:32:53.165849 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:53.165974 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":358,"threads_started":1}
I20260806 19:32:53.318352 10319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:53.317490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:53375)
0806 19:32:53.318003 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:53.318150 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":265,"threads_started":1}
I20260806 19:32:53.736495 10321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:53.735699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.66:39311)
0806 19:32:53.736182 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:53.736302 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":230,"threads_started":1}
I20260806 19:32:54.168493 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:54.167604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.65:46479)
0806 19:32:54.168216 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:54.168324 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":281,"threads_started":1}
I20260806 19:32:54.295403 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 9620
I20260806 19:32:54.320612 10324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:54.319633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:45293 (local address 127.17.18.67:33091)
0806 19:32:54.320238 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:54.320359 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.126:45293: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":319,"threads_started":1}
I20260806 19:32:54.321338 10323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:54.296829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43722 (local address 127.17.18.65:42429)
0806 19:32:54.297681 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:54.297702 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:54.297757 (+ 55us) server_negotiation.cc:407] Connection header received
0806 19:32:54.299560 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:54.299572 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:54.300053 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:54.300426 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:54.302176 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.303463 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.304862 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.305671 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.305871 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:54.313851 (+ 7980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:54.313862 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:54.313882 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:54.313946 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:54.317169 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.318122 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.318132 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.318140 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.318365 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.318812 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.318816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.318818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.319556 (+ 738us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:54.319922 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:54.320409 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 19:32:54.321023 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":368,"threads_started":1}
I20260806 19:32:54.323024 9859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:54.410244 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 9620
I20260806 19:32:54.437708 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 9875
I20260806 19:32:54.457741 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:54.438647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.17.18.66:32871)
0806 19:32:54.439140 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:54.439155 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:54.439197 (+ 42us) server_negotiation.cc:407] Connection header received
0806 19:32:54.440741 (+ 1544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:54.440753 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:54.441208 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:54.441606 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:54.443200 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.444486 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.445963 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.446769 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.446961 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:54.450648 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:54.450658 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:54.450678 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:54.450736 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:54.453952 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.454742 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.454751 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.454760 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.454959 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.455410 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.455414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.455416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.456014 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:54.456325 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:54.456877 (+ 552us) server_negotiation.cc:299] Negotiation successful
0806 19:32:54.457347 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":222,"threads_started":1}
I20260806 19:32:54.459288 10044 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:54.550884 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 9875
I20260806 19:32:54.578085 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 10055
I20260806 19:32:54.600339 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:54.579212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51380 (local address 127.17.18.67:44827)
0806 19:32:54.579841 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:54.579856 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:54.579902 (+ 46us) server_negotiation.cc:407] Connection header received
0806 19:32:54.581848 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:54.581866 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:54.582583 (+ 717us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:54.582965 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:54.584883 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.586634 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.588253 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:54.589051 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:54.589234 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:54.592348 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:54.592359 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:54.592380 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:54.592438 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:54.595792 (+ 3354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.596786 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.596796 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.596805 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.597032 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:54.597781 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:54.597786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:54.597788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:54.598517 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:54.598820 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:54.599487 (+ 667us) server_negotiation.cc:299] Negotiation successful
0806 19:32:54.600005 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":269,"threads_started":1}
I20260806 19:32:54.602521 10239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:54.693285 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 10055
2026-08-06T19:32:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66060 ms)
[----------] 30 tests from SecurityITest (329096 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:32:54 dist-test-slave-f0tn krb5kdc[10336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:32:54 dist-test-slave-f0tn krb5kdc[10336](info): set up 2 sockets
Aug 06 19:32:54 dist-test-slave-f0tn krb5kdc[10336](info): commencing operation
krb5kdc: starting...
W20260806 19:32:55.961087 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:32:56 dist-test-slave-f0tn krb5kdc[10336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:32:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:32:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:32:56.333700 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43607
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:32:56.719607 10354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:56.719977 10354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:56.720117 10354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:56.728688 10354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:32:56.728842 10354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:56.728914 10354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:56.729004 10354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:32:56.729072 10354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:32:56.740517 10354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:56.742115 10354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:56.743678 10354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:56.757877 10367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:56.757936 10364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:56.758061 10365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:56.758638 10354 server_base.cc:1034] running on GCE node
I20260806 19:32:56.759718 10354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:56.761633 10354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:56.762914 10354 hybrid_clock.cc:648] HybridClock initialized: now 1786044776762856 us; error 47 us; skew 500 ppm
I20260806 19:32:56.763368 10354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:56 dist-test-slave-f0tn krb5kdc[10336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:56.767032 10354 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:32:56.768852 10354 webserver.cc:460] Webserver started at http://127.17.18.126:44011/ using document root <none> and password file <none>
I20260806 19:32:56.769676 10354 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:56.769802 10354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:56.770140 10354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:32:56.773653 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "66789f6ff52646a2a368aab12301b267"
format_stamp: "Formatted at 2026-08-06 19:32:56 on dist-test-slave-f0tn"
server_key: "57fa53ca950ab875997ac96cc40679ce"
server_key_iv: "5a1fdfee0117efea2f31e41fd7a98205"
server_key_version: "encryptionkey@0"
I20260806 19:32:56.774544 10354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "66789f6ff52646a2a368aab12301b267"
format_stamp: "Formatted at 2026-08-06 19:32:56 on dist-test-slave-f0tn"
server_key: "57fa53ca950ab875997ac96cc40679ce"
server_key_iv: "5a1fdfee0117efea2f31e41fd7a98205"
server_key_version: "encryptionkey@0"
I20260806 19:32:56.780958 10354 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:32:56.785326 10379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:56.787046 10354 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:32:56.787263 10354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "66789f6ff52646a2a368aab12301b267"
format_stamp: "Formatted at 2026-08-06 19:32:56 on dist-test-slave-f0tn"
server_key: "57fa53ca950ab875997ac96cc40679ce"
server_key_iv: "5a1fdfee0117efea2f31e41fd7a98205"
server_key_version: "encryptionkey@0"
I20260806 19:32:56.787487 10354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:56.807551 10354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:56.813215 10354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:56.813585 10354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:56.834331 10444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43607 every 8 connection(s)
I20260806 19:32:56.834432 10354 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43607
I20260806 19:32:56.836232 10354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:32:56.840616 10446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:56.841961 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 10354
I20260806 19:32:56.842209 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:32:56.843084 17481 external_mini_cluster.cc:1428] Setting key 7dd079e0bf20925fb350e346ee2c53e4
I20260806 19:32:56.856689 10446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: Bootstrap starting.
Aug 06 19:32:56 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:56.861089 10446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:56.862402 10446 log.cc:824] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:56.866380 10446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: No bootstrap required, opened a new log
I20260806 19:32:56.870591 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:56.845470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54330 (local address 127.17.18.126:43607)
0806 19:32:56.846347 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:56.846359 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:56.846409 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:32:56.848153 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:56.848186 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:56.848641 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:56.849022 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:56.851017 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:56.852455 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:56.854517 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:56.855306 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:56.855470 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:56.860875 (+ 5405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:56.860886 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:56.860905 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:56.860961 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:56.864706 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:56.865864 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:56.865872 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:56.865880 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:56.866081 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:56.866649 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:56.866655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:56.866658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:56.867481 (+ 823us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:56.867828 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:56.868351 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 19:32:56.868936 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":417,"threads_started":1}
I20260806 19:32:56.876246 10446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } }
I20260806 19:32:56.876672 10446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:56.876752 10446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66789f6ff52646a2a368aab12301b267, State: Initialized, Role: FOLLOWER
I20260806 19:32:56.877305 10446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } }
I20260806 19:32:56.877619 10446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:32:56.877746 10446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:32:56.877877 10446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:56.880151 10446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } }
I20260806 19:32:56.880702 10446 leader_election.cc:302] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66789f6ff52646a2a368aab12301b267; no voters:
I20260806 19:32:56.881326 10446 leader_election.cc:288] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:32:56.881511 10454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:32:56.882210 10454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [term 1 LEADER]: Becoming Leader. State: Replica: 66789f6ff52646a2a368aab12301b267, State: Running, Role: LEADER
I20260806 19:32:56.882829 10454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } }
I20260806 19:32:56.883554 10446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:32:56.885978 10456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66789f6ff52646a2a368aab12301b267. Latest consensus state: current_term: 1 leader_uuid: "66789f6ff52646a2a368aab12301b267" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } } }
I20260806 19:32:56.886680 10456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:56.886185 10455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66789f6ff52646a2a368aab12301b267" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66789f6ff52646a2a368aab12301b267" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43607 } } }
I20260806 19:32:56.886861 10455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267 [sys.catalog]: This master's current role is: LEADER
I20260806 19:32:56.888300 10462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:32:56.893453 10462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:32:56.904500 10462 catalog_manager.cc:1347] Generated new cluster ID: 79e7309d464241f1bda631d3d65e450e
I20260806 19:32:56.904650 10462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:32:56.928246 10462 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:32:56.930488 10462 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:32:56.954984 10462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: Generated new TSK 0
I20260806 19:32:56.955930 10462 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:32:57.058554 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:32:57.479866 10482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:57.480226 10482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:57.480386 10482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:57.488556 10482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:57.488726 10482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:57.488897 10482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:32:57.500078 10482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:57.501662 10482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:57.503289 10482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:57.518426 10489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:57.518486 10491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:57.518656 10495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:57.519315 10482 server_base.cc:1034] running on GCE node
I20260806 19:32:57.520020 10482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:57.521122 10482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:57.522362 10482 hybrid_clock.cc:648] HybridClock initialized: now 1786044777522288 us; error 67 us; skew 500 ppm
I20260806 19:32:57.522730 10482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:57 dist-test-slave-f0tn krb5kdc[10336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044777, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:57.526423 10482 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:32:57.528316 10482 webserver.cc:460] Webserver started at http://127.17.18.65:34597/ using document root <none> and password file <none>
I20260806 19:32:57.529101 10482 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:57.529261 10482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:57.529660 10482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:32:57.532969 10482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "9121e4bac199422884d9cdd39f05ad26"
format_stamp: "Formatted at 2026-08-06 19:32:57 on dist-test-slave-f0tn"
server_key: "bce5fd479d267ae742b2876c97158823"
server_key_iv: "ccd2244f41fcac14e5acc9fd9fa3876e"
server_key_version: "encryptionkey@0"
I20260806 19:32:57.533907 10482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "9121e4bac199422884d9cdd39f05ad26"
format_stamp: "Formatted at 2026-08-06 19:32:57 on dist-test-slave-f0tn"
server_key: "bce5fd479d267ae742b2876c97158823"
server_key_iv: "ccd2244f41fcac14e5acc9fd9fa3876e"
server_key_version: "encryptionkey@0"
I20260806 19:32:57.540235 10482 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 19:32:57.544744 10514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:57.546481 10482 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 19:32:57.546778 10482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "9121e4bac199422884d9cdd39f05ad26"
format_stamp: "Formatted at 2026-08-06 19:32:57 on dist-test-slave-f0tn"
server_key: "bce5fd479d267ae742b2876c97158823"
server_key_iv: "ccd2244f41fcac14e5acc9fd9fa3876e"
server_key_version: "encryptionkey@0"
I20260806 19:32:57.547056 10482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:57.566422 10482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:57.571489 10482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:57.571964 10482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:57.573215 10482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:57.574939 10482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:57.575038 10482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:57.575188 10482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:57.575248 10482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:57.614054 10482 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:41987
I20260806 19:32:57.614121 10682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:41987 every 8 connection(s)
I20260806 19:32:57.615489 10482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:32:57.618247 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 10482
I20260806 19:32:57.618528 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:32:57.619496 17481 external_mini_cluster.cc:1428] Setting key 96cfd76db70c50cd6898ad46bd3fa209
Aug 06 19:32:57 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044777, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:57.638903 10686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:57.618566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48347 (local address 127.17.18.126:43607)
0806 19:32:57.619184 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:57.619191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:57.620341 (+ 1150us) server_negotiation.cc:407] Connection header received
0806 19:32:57.622417 (+ 2076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:57.622423 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:57.622509 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:57.622624 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:57.624361 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:57.625304 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:57.627108 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:57.627662 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:57.627800 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:57.631746 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:57.631754 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:57.631759 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:57.631810 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:57.635088 (+ 3278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:57.636104 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:57.636110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:57.636113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:57.636277 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:57.636803 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:57.636808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:57.636810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:57.637127 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:57.637294 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:57.638213 (+ 919us) server_negotiation.cc:299] Negotiation successful
0806 19:32:57.638516 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":293,"threads_started":1}
I20260806 19:32:57.640046 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:57.619132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43607 (local address 127.17.18.65:48347)
0806 19:32:57.620125 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:57.620187 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:57.622111 (+ 1924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:57.622885 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:57.622895 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:57.623487 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:57.624157 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:57.624178 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:57.625548 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:57.625552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:57.626931 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:57.626947 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:57.627942 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:57.627948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:57.628192 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:57.628948 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:57.628975 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:57.631437 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:57.635322 (+ 3885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:57.635333 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:57.635350 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:57.635944 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:57.636398 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:57.636402 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:57.636404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:57.636642 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:57.637286 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:57.637296 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:57.637781 (+ 485us) client_negotiation.cc:769] Sending connection context
0806 19:32:57.638072 (+ 291us) client_negotiation.cc:240] Negotiation successful
0806 19:32:57.638739 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":389,"threads_started":1}
I20260806 19:32:57.641908 10683 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43607
I20260806 19:32:57.642292 10683 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:57.643396 10683 heartbeater.cc:511] Master 127.17.18.126:43607 requested a full tablet report, sending...
I20260806 19:32:57.646142 10402 ts_manager.cc:194] Registered new tserver with Master: 9121e4bac199422884d9cdd39f05ad26 (127.17.18.65:41987)
I20260806 19:32:57.647723 10402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:48347
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:32:57.698127 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:32:58.075877 10694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:58.076223 10694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:58.076375 10694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:58.084075 10694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:58.084230 10694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:58.084389 10694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:32:58.095110 10694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:58.096575 10694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:58.098095 10694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:58.113025 10703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:58.113003 10704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:58.113098 10706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:58.114504 10694 server_base.cc:1034] running on GCE node
I20260806 19:32:58.115218 10694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:58.116303 10694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:58.117513 10694 hybrid_clock.cc:648] HybridClock initialized: now 1786044778117468 us; error 62 us; skew 500 ppm
I20260806 19:32:58.118010 10694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:58 dist-test-slave-f0tn krb5kdc[10336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044778, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:58.121572 10694 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:32:58.123445 10694 webserver.cc:460] Webserver started at http://127.17.18.66:35069/ using document root <none> and password file <none>
I20260806 19:32:58.124219 10694 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:58.124359 10694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:58.124714 10694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:32:58.128144 10694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "1288bb1e48c04f798d52660aaca5978f"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "aaa36397ed864fc7d448fc75b7badaf9"
server_key_iv: "ab7675735c7b0e3ca16d70ebacf58af8"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.129082 10694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "1288bb1e48c04f798d52660aaca5978f"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "aaa36397ed864fc7d448fc75b7badaf9"
server_key_iv: "ab7675735c7b0e3ca16d70ebacf58af8"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.135345 10694 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 19:32:58.139680 10719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.141531 10694 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:32:58.141763 10694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "1288bb1e48c04f798d52660aaca5978f"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "aaa36397ed864fc7d448fc75b7badaf9"
server_key_iv: "ab7675735c7b0e3ca16d70ebacf58af8"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.142002 10694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:58.166566 10694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:58.171826 10694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:58.172169 10694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:58.173399 10694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:58.174996 10694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:58.175088 10694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.175176 10694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:58.175230 10694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.209216 10694 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:43637
I20260806 19:32:58.209273 10872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:43637 every 8 connection(s)
I20260806 19:32:58.210711 10694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:32:58.214576 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 10694
I20260806 19:32:58.214782 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:32:58.215436 17481 external_mini_cluster.cc:1428] Setting key 808949bdc7ac65edfe62d65f9d90f0d3
Aug 06 19:32:58 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044778, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:58.237104 10875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.213877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:43317 (local address 127.17.18.126:43607)
0806 19:32:58.214393 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.214399 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.215650 (+ 1251us) server_negotiation.cc:407] Connection header received
0806 19:32:58.218512 (+ 2862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.218518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.218594 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.218728 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:58.221164 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.222001 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.224378 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.224889 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.225023 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.230101 (+ 5078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:58.230108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:58.230112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:58.230176 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:58.233147 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.234323 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.234328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.234335 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.234480 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.235040 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.235045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.235048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.235431 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:58.235586 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.236483 (+ 897us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.236740 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":243,"threads_started":1}
I20260806 19:32:58.238251 10877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.214478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43607 (local address 127.17.18.66:43317)
0806 19:32:58.215423 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:58.215495 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:58.218149 (+ 2654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:58.219063 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:58.219078 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:58.219914 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:58.220861 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.220896 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.222201 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.222207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.224127 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.224149 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.225187 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.225203 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.225572 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.226420 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:58.226459 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:58.229728 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:58.233409 (+ 3681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:58.233423 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:58.233448 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:58.234158 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:58.234623 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:58.234628 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:58.234632 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:58.234913 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:58.235619 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:58.235626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:58.236044 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 19:32:58.236328 (+ 284us) client_negotiation.cc:240] Negotiation successful
0806 19:32:58.236809 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":340,"threads_started":1}
I20260806 19:32:58.239904 10873 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43607
I20260806 19:32:58.240317 10873 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:58.241299 10873 heartbeater.cc:511] Master 127.17.18.126:43607 requested a full tablet report, sending...
I20260806 19:32:58.243338 10402 ts_manager.cc:194] Registered new tserver with Master: 1288bb1e48c04f798d52660aaca5978f (127.17.18.66:43637)
I20260806 19:32:58.244248 10402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:43317
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:32:58.301133 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:32:58.652056 10683 heartbeater.cc:503] Master 127.17.18.126:43607 was elected leader, sending a full tablet report...
W20260806 19:32:58.673008 10880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:32:58.673346 10880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:32:58.673499 10880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:32:58.681231 10880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:32:58.681398 10880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:32:58.681527 10880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:32:58.692862 10880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:43607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:32:58.694453 10880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:32:58.695990 10880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:32:58.710899 10888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:58.710914 10891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:32:58.711015 10887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:32:58.711848 10880 server_base.cc:1034] running on GCE node
I20260806 19:32:58.712579 10880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:32:58.713716 10880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:32:58.714953 10880 hybrid_clock.cc:648] HybridClock initialized: now 1786044778714896 us; error 43 us; skew 500 ppm
I20260806 19:32:58.715328 10880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:32:58 dist-test-slave-f0tn krb5kdc[10336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044778, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:32:58.719044 10880 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:32:58.720714 10880 webserver.cc:460] Webserver started at http://127.17.18.67:41763/ using document root <none> and password file <none>
I20260806 19:32:58.721525 10880 fs_manager.cc:359] Metadata directory not provided
I20260806 19:32:58.721665 10880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:32:58.722028 10880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:32:58.725239 10880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "c368e4c600e0432ca48bcb19d65057e8"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "4cd8a00bb6bed374eb79a18f95a1dde4"
server_key_iv: "ca812b19ce5d1bfb3ef2e7e5ac7cd0a9"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.726186 10880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "c368e4c600e0432ca48bcb19d65057e8"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "4cd8a00bb6bed374eb79a18f95a1dde4"
server_key_iv: "ca812b19ce5d1bfb3ef2e7e5ac7cd0a9"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.732221 10880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260806 19:32:58.736265 10900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.737860 10880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:32:58.738052 10880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "c368e4c600e0432ca48bcb19d65057e8"
format_stamp: "Formatted at 2026-08-06 19:32:58 on dist-test-slave-f0tn"
server_key: "4cd8a00bb6bed374eb79a18f95a1dde4"
server_key_iv: "ca812b19ce5d1bfb3ef2e7e5ac7cd0a9"
server_key_version: "encryptionkey@0"
I20260806 19:32:58.738286 10880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:32:58.763351 10880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:32:58.768193 10880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:32:58.768510 10880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:32:58.769649 10880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:32:58.771118 10880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:32:58.771203 10880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.771337 10880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:32:58.771394 10880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:32:58.805693 10880 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:40791
I20260806 19:32:58.805786 11071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:40791 every 8 connection(s)
I20260806 19:32:58.807183 10880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:32:58.807958 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 10880
I20260806 19:32:58.808373 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:32:58.809237 17481 external_mini_cluster.cc:1428] Setting key 66f28a219c94f95ec1538ba5bf8bf7ce
Aug 06 19:32:58 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044778, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:32:58.831729 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.811812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:51309 (local address 127.17.18.126:43607)
0806 19:32:58.812413 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.812419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.813901 (+ 1482us) server_negotiation.cc:407] Connection header received
0806 19:32:58.815932 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.815938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.816067 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.816171 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:58.818051 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.818846 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.820526 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.820941 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.821062 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.824905 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:58.824911 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:58.824915 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:58.825015 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:58.828271 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.829162 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.829169 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.829171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.829306 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.829807 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.829811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.829814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.830118 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:58.830269 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.831083 (+ 814us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.831347 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":1439,"threads_started":1}
I20260806 19:32:58.832842 11077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.812641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43607 (local address 127.17.18.67:51309)
0806 19:32:58.813735 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:58.813786 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:58.815617 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:58.816481 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:58.816491 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:58.817120 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:32:58.817842 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.817865 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.819022 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.819026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.820365 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.820380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.821205 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.821214 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.821510 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.822214 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:32:58.822241 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:32:58.824655 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:32:58.828460 (+ 3805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:58.828469 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:58.828486 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:58.829008 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:58.829448 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:32:58.829452 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:32:58.829454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:32:58.829682 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:32:58.830270 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:32:58.830280 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:32:58.830668 (+ 388us) client_negotiation.cc:769] Sending connection context
0806 19:32:58.830935 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 19:32:58.831534 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":393,"threads_started":1}
I20260806 19:32:58.834545 11073 heartbeater.cc:347] Connected to a master server at 127.17.18.126:43607
I20260806 19:32:58.834879 11073 heartbeater.cc:464] Registering TS with master...
I20260806 19:32:58.835650 11073 heartbeater.cc:511] Master 127.17.18.126:43607 requested a full tablet report, sending...
I20260806 19:32:58.837256 10402 ts_manager.cc:194] Registered new tserver with Master: c368e4c600e0432ca48bcb19d65057e8 (127.17.18.67:40791)
I20260806 19:32:58.838358 10402 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:51309
I20260806 19:32:58.839608 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:32:58.858748 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.845348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54338 (local address 127.17.18.126:43607)
0806 19:32:58.845579 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.845587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.846040 (+ 453us) server_negotiation.cc:407] Connection header received
0806 19:32:58.846248 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.846252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.846338 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.846433 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:58.848007 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.848839 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.850378 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.850780 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.850880 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.853445 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:58.853451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:58.853454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:58.853491 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:58.856023 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.856680 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.856684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.856686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.856823 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:58.857169 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:58.857174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:58.857176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:58.857636 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:58.857844 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.858219 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.858423 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 19:32:58.863971 10402 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:32:58.871261 10402 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:32:58.897408 11095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.885840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:43637 (local address 127.0.0.1:56596)
0806 19:32:58.886706 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:58.886780 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:58.886962 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:58.888973 (+ 2011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:58.888978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:58.889010 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:58.889467 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.889480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.891519 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.891525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.894204 (+ 2679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.894225 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.896235 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.896549 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.896622 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 19:32:58.896759 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 19:32:58.896921 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"mutex_wait_us":97,"thread_start_us":536,"threads_started":1}
I20260806 19:32:58.897487 11104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.887527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:40791 (local address 127.0.0.1:52922)
0806 19:32:58.888071 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:58.888096 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:58.888229 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:58.890285 (+ 2056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:58.890291 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:58.890321 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:58.890734 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.890749 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.892982 (+ 2233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.892988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.895041 (+ 2053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.895054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.896587 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.896843 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.896879 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:32:58.896993 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 19:32:58.897118 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":25,"thread_start_us":290,"threads_started":1}
I20260806 19:32:58.897650 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.888062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.17.18.67:40791)
0806 19:32:58.889683 (+ 1621us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.889691 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.889724 (+ 33us) server_negotiation.cc:407] Connection header received
0806 19:32:58.889820 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.889827 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.890058 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.890254 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:58.890968 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.892753 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.895226 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.896238 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896387 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.896621 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.897069 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.897280 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1435,"thread_start_us":1260,"threads_started":1}
I20260806 19:32:58.898449 11096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.885870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41987 (local address 127.0.0.1:44040)
0806 19:32:58.886706 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:58.886780 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:58.886962 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:58.888433 (+ 1471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:58.888441 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:58.888472 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:58.888870 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.888886 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.891942 (+ 3056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.891947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.894491 (+ 2544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:58.894506 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.896463 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:58.897812 (+ 1342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.897846 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:32:58.897941 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 19:32:58.898078 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":1158,"spinlock_wait_cycles":5504,"thread_start_us":1263,"threads_started":1}
I20260806 19:32:58.898483 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.886569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56596 (local address 127.17.18.66:43637)
0806 19:32:58.888375 (+ 1806us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.888383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.888409 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:32:58.888500 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.888506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.888740 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.888951 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:58.889625 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.891261 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.894408 (+ 3147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.895990 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896161 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.896427 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.898001 (+ 1574us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.898199 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1620,"thread_start_us":1768,"threads_started":1}
I20260806 19:32:58.899233 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:58.887073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44040 (local address 127.17.18.65:41987)
0806 19:32:58.887732 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:58.887741 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:58.887771 (+ 30us) server_negotiation.cc:407] Connection header received
0806 19:32:58.887894 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:58.887903 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:58.888182 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:58.888440 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:58.889102 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.891672 (+ 2570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.894728 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:58.896202 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:58.896602 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:58.896981 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:58.898721 (+ 1740us) server_negotiation.cc:299] Negotiation successful
0806 19:32:58.898918 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":309,"threads_started":1}
I20260806 19:32:58.902137 10984 tablet_service.cc:1467] Processing CreateTablet for tablet 85ad2f4e016a4e82af161992848a375f (DEFAULT_TABLE table=test-table [id=80abe0583e5b41cb8733aac01ec91d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:58.902486 10783 tablet_service.cc:1467] Processing CreateTablet for tablet 85ad2f4e016a4e82af161992848a375f (DEFAULT_TABLE table=test-table [id=80abe0583e5b41cb8733aac01ec91d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:58.902639 10587 tablet_service.cc:1467] Processing CreateTablet for tablet 85ad2f4e016a4e82af161992848a375f (DEFAULT_TABLE table=test-table [id=80abe0583e5b41cb8733aac01ec91d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:32:58.903600 10984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85ad2f4e016a4e82af161992848a375f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:58.903980 10783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85ad2f4e016a4e82af161992848a375f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:58.904893 10587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85ad2f4e016a4e82af161992848a375f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:32:58.917011 11108 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Bootstrap starting.
I20260806 19:32:58.920969 11109 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Bootstrap starting.
I20260806 19:32:58.922034 11111 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Bootstrap starting.
I20260806 19:32:58.922518 11108 tablet_bootstrap.cc:654] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:58.924094 11108 log.cc:824] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:58.925123 11109 tablet_bootstrap.cc:654] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:58.925423 11111 tablet_bootstrap.cc:654] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Neither blocks nor log segments found. Creating new log.
I20260806 19:32:58.926600 11111 log.cc:824] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:58.926641 11109 log.cc:824] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Log is configured to *not* fsync() on all Append() calls
I20260806 19:32:58.928354 11108 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: No bootstrap required, opened a new log
I20260806 19:32:58.928757 11108 ts_tablet_manager.cc:1397] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260806 19:32:58.929903 11111 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: No bootstrap required, opened a new log
I20260806 19:32:58.930284 11111 ts_tablet_manager.cc:1397] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 19:32:58.937105 11109 tablet_bootstrap.cc:492] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: No bootstrap required, opened a new log
I20260806 19:32:58.937556 11109 ts_tablet_manager.cc:1397] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20260806 19:32:58.938458 11111 raft_consensus.cc:348] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.938874 11111 raft_consensus.cc:374] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:58.938979 11111 raft_consensus.cc:729] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9121e4bac199422884d9cdd39f05ad26, State: Initialized, Role: FOLLOWER
I20260806 19:32:58.939653 11111 consensus_queue.cc:260] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.941181 11108 raft_consensus.cc:348] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.941784 11108 raft_consensus.cc:374] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:58.941960 11108 raft_consensus.cc:729] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c368e4c600e0432ca48bcb19d65057e8, State: Initialized, Role: FOLLOWER
I20260806 19:32:58.943250 11111 ts_tablet_manager.cc:1428] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Time spent starting tablet: real 0.013s user 0.005s sys 0.007s
I20260806 19:32:58.944401 11108 consensus_queue.cc:260] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.945760 11073 heartbeater.cc:503] Master 127.17.18.126:43607 was elected leader, sending a full tablet report...
I20260806 19:32:58.946648 11108 ts_tablet_manager.cc:1428] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
I20260806 19:32:58.949106 11109 raft_consensus.cc:348] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.949740 11109 raft_consensus.cc:374] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:32:58.949875 11109 raft_consensus.cc:729] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1288bb1e48c04f798d52660aaca5978f, State: Initialized, Role: FOLLOWER
I20260806 19:32:58.950570 11109 consensus_queue.cc:260] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:58.951865 10873 heartbeater.cc:503] Master 127.17.18.126:43607 was elected leader, sending a full tablet report...
I20260806 19:32:58.952625 11109 ts_tablet_manager.cc:1428] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260806 19:32:58.963310 10874 tablet.cc:2369] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:32:59.016788 11117 raft_consensus.cc:482] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:32:59.017079 11117 raft_consensus.cc:504] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:59.018945 11117 leader_election.cc:288] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1288bb1e48c04f798d52660aaca5978f (127.17.18.66:43637), 9121e4bac199422884d9cdd39f05ad26 (127.17.18.65:41987)
I20260806 19:32:59.025988 11077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.019380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41987 (local address 127.17.18.67:37373)
0806 19:32:59.019773 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:59.019795 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:59.019957 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:59.020404 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:59.020408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:59.020437 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:59.020707 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:59.020720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.022149 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.022155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:59.023724 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:59.023738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.025142 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.025149 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:59.025361 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.025434 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 19:32:59.025549 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 19:32:59.025706 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":1,"spinlock_wait_cycles":8448}
I20260806 19:32:59.026109 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.019519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:37373 (local address 127.17.18.65:41987)
0806 19:32:59.019829 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.019835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.019860 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:32:59.020133 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.020146 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.020231 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.020340 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:59.020925 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.021963 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.023908 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.024945 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.025095 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.025157 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.025610 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.025778 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260806 19:32:59.026615 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.019615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:48063 (local address 127.17.18.66:43637)
0806 19:32:59.019834 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.019839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.020524 (+ 685us) server_negotiation.cc:407] Connection header received
0806 19:32:59.020696 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.020701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.020782 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.020872 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:32:59.021625 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.022505 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.024471 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.025507 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.025662 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.025731 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.026277 (+ 546us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.026405 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 19:32:59.027208 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.019484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:43637 (local address 127.17.18.67:48063)
0806 19:32:59.020376 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0806 19:32:59.020395 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:32:59.020551 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:32:59.020937 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:32:59.020942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:32:59.020971 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:32:59.021426 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:59.021441 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.022685 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.022690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:59.024284 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:32:59.024300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.025784 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.025791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:32:59.025985 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.026020 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:32:59.026129 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 19:32:59.026892 (+ 763us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":22,"spinlock_wait_cycles":768,"thread_start_us":491,"threads_started":1}
I20260806 19:32:59.027360 10619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85ad2f4e016a4e82af161992848a375f" candidate_uuid: "c368e4c600e0432ca48bcb19d65057e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9121e4bac199422884d9cdd39f05ad26" is_pre_election: true
I20260806 19:32:59.027951 10619 raft_consensus.cc:2454] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c368e4c600e0432ca48bcb19d65057e8 in term 0.
I20260806 19:32:59.028216 10808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85ad2f4e016a4e82af161992848a375f" candidate_uuid: "c368e4c600e0432ca48bcb19d65057e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1288bb1e48c04f798d52660aaca5978f" is_pre_election: true
I20260806 19:32:59.028770 10901 leader_election.cc:302] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9121e4bac199422884d9cdd39f05ad26, c368e4c600e0432ca48bcb19d65057e8; no voters:
I20260806 19:32:59.028787 10808 raft_consensus.cc:2454] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c368e4c600e0432ca48bcb19d65057e8 in term 0.
I20260806 19:32:59.029197 11117 raft_consensus.cc:2781] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:32:59.029346 11117 raft_consensus.cc:482] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:32:59.029491 11117 raft_consensus.cc:3037] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:59.031868 11117 raft_consensus.cc:504] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:59.032545 11117 leader_election.cc:288] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [CANDIDATE]: Term 1 election: Requested vote from peers 1288bb1e48c04f798d52660aaca5978f (127.17.18.66:43637), 9121e4bac199422884d9cdd39f05ad26 (127.17.18.65:41987)
I20260806 19:32:59.033107 10808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85ad2f4e016a4e82af161992848a375f" candidate_uuid: "c368e4c600e0432ca48bcb19d65057e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1288bb1e48c04f798d52660aaca5978f"
I20260806 19:32:59.033170 10619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85ad2f4e016a4e82af161992848a375f" candidate_uuid: "c368e4c600e0432ca48bcb19d65057e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9121e4bac199422884d9cdd39f05ad26"
I20260806 19:32:59.033365 10808 raft_consensus.cc:3037] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:59.033421 10619 raft_consensus.cc:3037] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:32:59.036783 10619 raft_consensus.cc:2454] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c368e4c600e0432ca48bcb19d65057e8 in term 1.
I20260806 19:32:59.036783 10808 raft_consensus.cc:2454] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c368e4c600e0432ca48bcb19d65057e8 in term 1.
I20260806 19:32:59.037331 10904 leader_election.cc:302] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1288bb1e48c04f798d52660aaca5978f, c368e4c600e0432ca48bcb19d65057e8; no voters:
I20260806 19:32:59.037742 11117 raft_consensus.cc:2781] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:32:59.038307 11117 raft_consensus.cc:686] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 1 LEADER]: Becoming Leader. State: Replica: c368e4c600e0432ca48bcb19d65057e8, State: Running, Role: LEADER
I20260806 19:32:59.038818 11117 consensus_queue.cc:237] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } }
I20260806 19:32:59.044112 10402 catalog_manager.cc:5495] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c368e4c600e0432ca48bcb19d65057e8 (127.17.18.67). New cstate: current_term: 1 leader_uuid: "c368e4c600e0432ca48bcb19d65057e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c368e4c600e0432ca48bcb19d65057e8" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 40791 } health_report { overall_health: HEALTHY } } }
W20260806 19:32:59.059791 11074 tablet.cc:2369] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:32:59.096771 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.090867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52936 (local address 127.17.18.67:40791)
0806 19:32:59.091068 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.091074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.091181 (+ 107us) server_negotiation.cc:407] Connection header received
0806 19:32:59.091373 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.091382 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.091469 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.091603 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:32:59.092112 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.092887 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.094446 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.094861 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.094961 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.095574 (+ 613us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:32:59.096144 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:32:59.096278 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.096460 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.096548 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 19:32:59.105849 10808 raft_consensus.cc:1261] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 1 FOLLOWER]: Refusing update from remote peer c368e4c600e0432ca48bcb19d65057e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:32:59.105849 10619 raft_consensus.cc:1261] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 1 FOLLOWER]: Refusing update from remote peer c368e4c600e0432ca48bcb19d65057e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:32:59.107088 11120 consensus_queue.cc:1035] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1288bb1e48c04f798d52660aaca5978f" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 43637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:32:59.107513 11117 consensus_queue.cc:1035] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9121e4bac199422884d9cdd39f05ad26" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 19:32:59.118275 10684 tablet.cc:2369] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:32:59.146836 10401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:32:59.147149 10401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:32:59.151419 10401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66789f6ff52646a2a368aab12301b267: Sending DeleteTablet for 3 replicas of tablet 85ad2f4e016a4e82af161992848a375f
I20260806 19:32:59.152781 10783 tablet_service.cc:1514] Processing DeleteTablet for tablet 85ad2f4e016a4e82af161992848a375f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:59 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:56596
I20260806 19:32:59.153677 10984 tablet_service.cc:1514] Processing DeleteTablet for tablet 85ad2f4e016a4e82af161992848a375f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:59 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:52922
I20260806 19:32:59.153959 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 10482
I20260806 19:32:59.154713 11144 tablet_replica.cc:330] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: stopping tablet replica
I20260806 19:32:59.155189 10587 tablet_service.cc:1514] Processing DeleteTablet for tablet 85ad2f4e016a4e82af161992848a375f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:32:59 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:44040
I20260806 19:32:59.155311 11144 raft_consensus.cc:2229] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:32:59.156697 11144 raft_consensus.cc:2258] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:59.159453 11144 ts_tablet_manager.cc:1905] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:59.162940 11146 tablet_replica.cc:330] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: stopping tablet replica
I20260806 19:32:59.163515 11146 raft_consensus.cc:2229] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:32:59.164119 11146 raft_consensus.cc:2258] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:59.167431 11143 tablet_replica.cc:330] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: stopping tablet replica
I20260806 19:32:59.167959 11143 raft_consensus.cc:2229] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:32:59.168581 11143 raft_consensus.cc:2258] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:32:59.169081 11144 ts_tablet_manager.cc:1918] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:59.169414 11144 log.cc:1196] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/85ad2f4e016a4e82af161992848a375f
I20260806 19:32:59.170145 11144 ts_tablet_manager.cc:1939] T 85ad2f4e016a4e82af161992848a375f P c368e4c600e0432ca48bcb19d65057e8: Deleting consensus metadata
I20260806 19:32:59.170691 11146 ts_tablet_manager.cc:1905] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:59.172497 10380 catalog_manager.cc:4841] TS c368e4c600e0432ca48bcb19d65057e8 (127.17.18.67:40791): tablet 85ad2f4e016a4e82af161992848a375f (table test-table [id=80abe0583e5b41cb8733aac01ec91d38]) successfully deleted
I20260806 19:32:59.175576 11143 ts_tablet_manager.cc:1905] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:32:59.180261 11146 ts_tablet_manager.cc:1918] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:59.180501 11146 log.cc:1196] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/85ad2f4e016a4e82af161992848a375f
Aug 06 19:32:59 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:32:59.181149 11146 ts_tablet_manager.cc:1939] T 85ad2f4e016a4e82af161992848a375f P 9121e4bac199422884d9cdd39f05ad26: Deleting consensus metadata
I20260806 19:32:59.183496 10380 catalog_manager.cc:4841] TS 9121e4bac199422884d9cdd39f05ad26 (127.17.18.65:41987): tablet 85ad2f4e016a4e82af161992848a375f (table test-table [id=80abe0583e5b41cb8733aac01ec91d38]) successfully deleted
I20260806 19:32:59.183930 11143 ts_tablet_manager.cc:1918] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:32:59.184134 11143 log.cc:1196] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/85ad2f4e016a4e82af161992848a375f
I20260806 19:32:59.184710 11143 ts_tablet_manager.cc:1939] T 85ad2f4e016a4e82af161992848a375f P 1288bb1e48c04f798d52660aaca5978f: Deleting consensus metadata
I20260806 19:32:59.186844 10381 catalog_manager.cc:4841] TS 1288bb1e48c04f798d52660aaca5978f (127.17.18.66:43637): tablet 85ad2f4e016a4e82af161992848a375f (table test-table [id=80abe0583e5b41cb8733aac01ec91d38]) successfully deleted
I20260806 19:32:59.190130 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.154765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.17.18.65:41987)
0806 19:32:59.154953 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.154959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.169849 (+ 14890us) server_negotiation.cc:407] Connection header received
0806 19:32:59.170425 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.170432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.170534 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.170618 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:59.172674 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.173741 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.175636 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.176292 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.176404 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.182383 (+ 5979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:59.182403 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:59.182423 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:59.182482 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:59.186629 (+ 4147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.187625 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.187637 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.187641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.187855 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.188240 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.188246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.188250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.188802 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:59.189160 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.189328 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.189632 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:32:59.190860 10676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:59.290540 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 10482
I20260806 19:32:59.328812 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 10694
Aug 06 19:32:59 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:32:59.354211 11100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.329722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56612 (local address 127.17.18.66:43637)
0806 19:32:59.329916 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.329922 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.329945 (+ 23us) server_negotiation.cc:407] Connection header received
0806 19:32:59.330113 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.330118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.330187 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.330272 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:59.331639 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.332414 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.333989 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.334398 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.334529 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.344208 (+ 9679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:59.344229 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:59.344249 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:59.344296 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:59.350000 (+ 5704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.351397 (+ 1397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.351411 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.351415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.351627 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.352139 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.352145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.352149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.352766 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:59.353116 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.353498 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.353784 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:32:59.355044 10867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:59.509434 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 10694
I20260806 19:32:59.535753 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 10880
Aug 06 19:32:59 dist-test-slave-f0tn krb5kdc[10336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:32:59.554602 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:32:59.536611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.17.18.67:40791)
0806 19:32:59.536796 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 19:32:59.536802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:32:59.536880 (+ 78us) server_negotiation.cc:407] Connection header received
0806 19:32:59.537067 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:32:59.537071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:32:59.537157 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:32:59.537267 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:32:59.538648 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.539459 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.540846 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:32:59.541352 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:32:59.541531 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:32:59.547820 (+ 6289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:32:59.547840 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:32:59.547863 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:32:59.547915 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:32:59.551268 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.552161 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.552170 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.552172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.552370 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:32:59.552792 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:32:59.552796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:32:59.552799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:32:59.553237 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:32:59.553780 (+ 543us) server_negotiation.cc:1035] Waiting for connection context
0806 19:32:59.553969 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 19:32:59.554242 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:32:59.555433 11066 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:59.690915 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 10880
I20260806 19:32:59.721784 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 10354
I20260806 19:32:59.723027 10439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:32:59.839818 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 10354
2026-08-06T19:32:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5151 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T19:32:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:32:59Z Disabled control of system clock
I20260806 19:32:59.951593 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42339
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:42339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:00.330219 11158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:00.330554 11158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:00.330653 11158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:00.338436 11158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:00.338567 11158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:00.338608 11158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:00.338670 11158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:00.338716 11158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:00.348598 11158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:42339
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:42339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:00.350039 11158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:00.352137 11158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:00.364955 11166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:00.365022 11167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:00.365218 11169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:00.365832 11158 server_base.cc:1034] running on GCE node
I20260806 19:33:00.366765 11158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:00.368458 11158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:00.369740 11158 hybrid_clock.cc:648] HybridClock initialized: now 1786044780369666 us; error 63 us; skew 500 ppm
I20260806 19:33:00.370290 11158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:00.373070 11158 webserver.cc:460] Webserver started at http://127.17.18.126:36011/ using document root <none> and password file <none>
I20260806 19:33:00.373967 11158 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:00.374104 11158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:00.374481 11158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:00.377918 11158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "aae21aa913ea47c0af2d721aa0a55ef3"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "c48508f17a01b82b654a08ea9c2f1698"
server_key_iv: "3516419e7e6b4fbcf6d18d77be154e62"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.378902 11158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "aae21aa913ea47c0af2d721aa0a55ef3"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "c48508f17a01b82b654a08ea9c2f1698"
server_key_iv: "3516419e7e6b4fbcf6d18d77be154e62"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.384925 11158 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:33:00.388985 11176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:00.390543 11158 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:00.390756 11158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "aae21aa913ea47c0af2d721aa0a55ef3"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "c48508f17a01b82b654a08ea9c2f1698"
server_key_iv: "3516419e7e6b4fbcf6d18d77be154e62"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.390990 11158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:00.408659 11158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:00.409693 11158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:00.409993 11158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:00.430214 11158 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:42339
I20260806 19:33:00.430239 11256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:42339 every 8 connection(s)
I20260806 19:33:00.431737 11158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:00.436095 11257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:00.440398 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 11158
I20260806 19:33:00.440615 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:00.441201 17481 external_mini_cluster.cc:1428] Setting key eeaf22db502b92014f6022c0b6053cb2
I20260806 19:33:00.451112 11257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: Bootstrap starting.
I20260806 19:33:00.455128 11257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:00.456337 11257 log.cc:824] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:00.456579 11260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:00.443372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.17.18.126:42339)
0806 19:33:00.444485 (+ 1113us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:00.444498 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:00.444546 (+ 48us) server_negotiation.cc:407] Connection header received
0806 19:33:00.446415 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:00.446451 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:00.447264 (+ 813us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:00.447818 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:00.448542 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:00.449996 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:00.451878 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:00.452607 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:00.452762 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:00.454077 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:00.454085 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:00.454100 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:00.454676 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:00.454779 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:00.454802 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:00.454892 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:00.455159 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 19:33:00.455524 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":409,"threads_started":1}
I20260806 19:33:00.460088 11257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: No bootstrap required, opened a new log
I20260806 19:33:00.468333 11257 raft_consensus.cc:348] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } }
I20260806 19:33:00.468815 11257 raft_consensus.cc:374] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:00.468935 11257 raft_consensus.cc:729] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae21aa913ea47c0af2d721aa0a55ef3, State: Initialized, Role: FOLLOWER
I20260806 19:33:00.469560 11257 consensus_queue.cc:260] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } }
I20260806 19:33:00.469815 11257 raft_consensus.cc:388] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:00.469923 11257 raft_consensus.cc:482] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:00.470062 11257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:00.472349 11257 raft_consensus.cc:504] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } }
I20260806 19:33:00.472883 11257 leader_election.cc:302] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aae21aa913ea47c0af2d721aa0a55ef3; no voters:
I20260806 19:33:00.473600 11257 leader_election.cc:288] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:00.473690 11262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:00.474809 11262 raft_consensus.cc:686] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [term 1 LEADER]: Becoming Leader. State: Replica: aae21aa913ea47c0af2d721aa0a55ef3, State: Running, Role: LEADER
I20260806 19:33:00.475407 11262 consensus_queue.cc:237] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } }
I20260806 19:33:00.476105 11257 sys_catalog.cc:564] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:00.478404 11267 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aae21aa913ea47c0af2d721aa0a55ef3. Latest consensus state: current_term: 1 leader_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } } }
I20260806 19:33:00.479076 11267 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:00.482324 11274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:00.482626 11264 sys_catalog.cc:455] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aae21aa913ea47c0af2d721aa0a55ef3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 42339 } } }
I20260806 19:33:00.482901 11264 sys_catalog.cc:458] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:00.488370 11274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:00.499244 11274 catalog_manager.cc:1347] Generated new cluster ID: 314c1a81f6554f23b1ff0396d243957b
I20260806 19:33:00.499380 11274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:00.527313 11274 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:00.529430 11274 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:00.538476 11274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: Generated new TSK 0
I20260806 19:33:00.539674 11274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:00.546346 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--builtin_ntp_servers=127.17.18.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:00.927312 11295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:00.927672 11295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:00.927793 11295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:00.935659 11295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:00.935798 11295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:00.935946 11295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:33:00.945996 11295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:00.947449 11295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:00.949362 11295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:00.965065 11301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:00.964962 11302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:00.965023 11305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:00.965801 11295 server_base.cc:1034] running on GCE node
I20260806 19:33:00.966558 11295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:00.967821 11295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:00.969053 11295 hybrid_clock.cc:648] HybridClock initialized: now 1786044780968994 us; error 51 us; skew 500 ppm
I20260806 19:33:00.969424 11295 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:00.971988 11295 webserver.cc:460] Webserver started at http://127.17.18.65:46215/ using document root <none> and password file <none>
I20260806 19:33:00.972793 11295 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:00.972910 11295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:00.973246 11295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:00.976687 11295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "98bb7e0590b74e689f6bc20636bac42d"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "cadca525be9c3d52aad5599d22895a15"
server_key_iv: "6dbcfe6afa49ce73503d6dab81cafeb7"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.977700 11295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "98bb7e0590b74e689f6bc20636bac42d"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "cadca525be9c3d52aad5599d22895a15"
server_key_iv: "6dbcfe6afa49ce73503d6dab81cafeb7"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.984452 11295 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 19:33:00.988925 11312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:00.990757 11295 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:33:00.991056 11295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "98bb7e0590b74e689f6bc20636bac42d"
format_stamp: "Formatted at 2026-08-06 19:33:00 on dist-test-slave-f0tn"
server_key: "cadca525be9c3d52aad5599d22895a15"
server_key_iv: "6dbcfe6afa49ce73503d6dab81cafeb7"
server_key_version: "encryptionkey@0"
I20260806 19:33:00.991358 11295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:01.017063 11295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:01.018177 11295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:01.018533 11295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:01.019739 11295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:01.021701 11295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:01.021831 11295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:01.021948 11295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:01.022027 11295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:01.057235 11295 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:46561
I20260806 19:33:01.057292 11487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:46561 every 8 connection(s)
I20260806 19:33:01.058732 11295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:33:01.062915 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 11295
I20260806 19:33:01.063228 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:33:01.063860 17481 external_mini_cluster.cc:1428] Setting key e0f68f0f94b6177880ff73b708a3703f
I20260806 19:33:01.067497 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--builtin_ntp_servers=127.17.18.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:01.075065 11491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:01.061863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:37629 (local address 127.17.18.126:42339)
0806 19:33:01.062369 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:01.062376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:01.064167 (+ 1791us) server_negotiation.cc:407] Connection header received
0806 19:33:01.066492 (+ 2325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:01.066497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:01.066587 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:01.066683 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:01.068355 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.069113 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.071447 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.072081 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.072210 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:01.074201 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:01.074206 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:01.074218 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:01.074241 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:01.074290 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:01.074303 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:01.074386 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:01.074659 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 19:33:01.074769 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":233,"threads_started":1}
I20260806 19:33:01.076651 11492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:01.062521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42339 (local address 127.17.18.65:37629)
0806 19:33:01.063895 (+ 1374us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:01.063964 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:01.066161 (+ 2197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:01.067013 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:01.067026 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:01.067184 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:01.068117 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:01.068146 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.069311 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.069317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:01.071236 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:01.071256 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.072432 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.072440 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:01.072788 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:01.073714 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:01.073718 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:01.073783 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:01.073914 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:01.074412 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:01.074423 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:01.074431 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:33:01.074632 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 19:33:01.075111 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":436,"threads_started":1}
I20260806 19:33:01.078672 11488 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42339
I20260806 19:33:01.079032 11488 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:01.079895 11488 heartbeater.cc:511] Master 127.17.18.126:42339 requested a full tablet report, sending...
I20260806 19:33:01.082686 11201 ts_manager.cc:194] Registered new tserver with Master: 98bb7e0590b74e689f6bc20636bac42d (127.17.18.65:46561)
I20260806 19:33:01.084563 11201 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.65:37629
W20260806 19:33:01.458680 11493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:01.459007 11493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:01.459103 11493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:01.466720 11493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:01.466848 11493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:01.466988 11493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:33:01.476680 11493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:01.478148 11493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:01.480086 11493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:01.495642 11501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:01.496444 11502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:01.496461 11505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:01.497356 11493 server_base.cc:1034] running on GCE node
I20260806 19:33:01.498100 11493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:01.499179 11493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:01.500430 11493 hybrid_clock.cc:648] HybridClock initialized: now 1786044781500373 us; error 52 us; skew 500 ppm
I20260806 19:33:01.500808 11493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:01.503405 11493 webserver.cc:460] Webserver started at http://127.17.18.66:42493/ using document root <none> and password file <none>
I20260806 19:33:01.504184 11493 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:01.504302 11493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:01.504626 11493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:01.507802 11493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb"
format_stamp: "Formatted at 2026-08-06 19:33:01 on dist-test-slave-f0tn"
server_key: "d705aa49264b1873027cb05954d2c8d3"
server_key_iv: "3efa7b2328ab725c1c7f150acc31a85f"
server_key_version: "encryptionkey@0"
I20260806 19:33:01.508652 11493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb"
format_stamp: "Formatted at 2026-08-06 19:33:01 on dist-test-slave-f0tn"
server_key: "d705aa49264b1873027cb05954d2c8d3"
server_key_iv: "3efa7b2328ab725c1c7f150acc31a85f"
server_key_version: "encryptionkey@0"
I20260806 19:33:01.514631 11493 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260806 19:33:01.518862 11512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:01.520488 11493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260806 19:33:01.520696 11493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb"
format_stamp: "Formatted at 2026-08-06 19:33:01 on dist-test-slave-f0tn"
server_key: "d705aa49264b1873027cb05954d2c8d3"
server_key_iv: "3efa7b2328ab725c1c7f150acc31a85f"
server_key_version: "encryptionkey@0"
I20260806 19:33:01.520951 11493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:01.547335 11493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:01.548311 11493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:01.548622 11493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:01.549732 11493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:01.551446 11493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:01.551545 11493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:01.551635 11493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:01.551693 11493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:01.585892 11493 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:36483
I20260806 19:33:01.585970 11683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:36483 every 8 connection(s)
I20260806 19:33:01.587267 11493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:33:01.591022 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 11493
I20260806 19:33:01.591231 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:33:01.591832 17481 external_mini_cluster.cc:1428] Setting key fd2f80630c61325928569a737ef8e2f9
I20260806 19:33:01.594821 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--builtin_ntp_servers=127.17.18.84:37057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:01.601449 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:01.590021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:39185 (local address 127.17.18.126:42339)
0806 19:33:01.590506 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:01.590511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:01.592006 (+ 1495us) server_negotiation.cc:407] Connection header received
0806 19:33:01.593922 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:01.593928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:01.594014 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:01.594113 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:01.595654 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.596490 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.598366 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.598821 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.598940 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:01.600470 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:01.600475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:01.600478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:01.600500 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:01.600548 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:01.600560 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:01.600640 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:01.600890 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 19:33:01.601011 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":248,"threads_started":1}
I20260806 19:33:01.602620 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:01.590571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42339 (local address 127.17.18.66:39185)
0806 19:33:01.591747 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:01.591798 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:01.593627 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:01.594444 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:01.594458 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:01.594585 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:01.595376 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:01.595401 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.596679 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.596685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:01.598188 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:01.598203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:01.599095 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:01.599105 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:01.599350 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:01.600085 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:01.600088 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:01.600137 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:01.600249 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:01.600657 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:01.600672 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:01.600679 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:33:01.600863 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 19:33:01.601361 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":365,"threads_started":1}
I20260806 19:33:01.604573 11684 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42339
I20260806 19:33:01.604928 11684 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:01.605829 11684 heartbeater.cc:511] Master 127.17.18.126:42339 requested a full tablet report, sending...
I20260806 19:33:01.607556 11201 ts_manager.cc:194] Registered new tserver with Master: 27f4c5cc24554f3e9389c19e7f5e0fcb (127.17.18.66:36483)
I20260806 19:33:01.608623 11201 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.66:39185
W20260806 19:33:01.980522 11691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:01.980918 11691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:01.981073 11691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:01.989154 11691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:01.989322 11691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:01.989540 11691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:33:02.000321 11691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:42339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:02.001909 11691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:02.003983 11691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:02.021116 11703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:02.021068 11699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:02.021025 11696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:02.022013 11691 server_base.cc:1034] running on GCE node
I20260806 19:33:02.023061 11691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:02.024533 11691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:02.025836 11691 hybrid_clock.cc:648] HybridClock initialized: now 1786044782025776 us; error 46 us; skew 500 ppm
I20260806 19:33:02.026298 11691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:02.029624 11691 webserver.cc:460] Webserver started at http://127.17.18.67:45357/ using document root <none> and password file <none>
I20260806 19:33:02.030494 11691 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:02.030622 11691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:02.030990 11691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:02.034497 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "6a6f5b13c8fe46119524a3f306f22274"
format_stamp: "Formatted at 2026-08-06 19:33:02 on dist-test-slave-f0tn"
server_key: "6fd7da5c263192cd2fa9f1bbd0dec8a3"
server_key_iv: "5ed4ae73dd9efbb860334cdd58d0cd26"
server_key_version: "encryptionkey@0"
I20260806 19:33:02.035419 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "6a6f5b13c8fe46119524a3f306f22274"
format_stamp: "Formatted at 2026-08-06 19:33:02 on dist-test-slave-f0tn"
server_key: "6fd7da5c263192cd2fa9f1bbd0dec8a3"
server_key_iv: "5ed4ae73dd9efbb860334cdd58d0cd26"
server_key_version: "encryptionkey@0"
I20260806 19:33:02.041714 11691 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:33:02.046128 11709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:02.047804 11691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:33:02.048020 11691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "6a6f5b13c8fe46119524a3f306f22274"
format_stamp: "Formatted at 2026-08-06 19:33:02 on dist-test-slave-f0tn"
server_key: "6fd7da5c263192cd2fa9f1bbd0dec8a3"
server_key_iv: "5ed4ae73dd9efbb860334cdd58d0cd26"
server_key_version: "encryptionkey@0"
I20260806 19:33:02.048507 11691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:02.086076 11691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:02.087072 11691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:02.087404 11691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:02.088742 11691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:02.089519 11488 heartbeater.cc:503] Master 127.17.18.126:42339 was elected leader, sending a full tablet report...
I20260806 19:33:02.090742 11691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:02.090879 11691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:02.091008 11691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:02.091095 11691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:02.126237 11691 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:42173
I20260806 19:33:02.126327 11880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:42173 every 8 connection(s)
I20260806 19:33:02.127646 11691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:33:02.134748 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 11691
I20260806 19:33:02.134944 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:33:02.135671 17481 external_mini_cluster.cc:1428] Setting key 45fdf0760c1bb8e70583db91faf4e289
I20260806 19:33:02.143571 11884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.130637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:47999 (local address 127.17.18.126:42339)
0806 19:33:02.131131 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.131136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.132712 (+ 1576us) server_negotiation.cc:407] Connection header received
0806 19:33:02.134759 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.134765 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.134856 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.134958 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:02.136956 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.137915 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.140243 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.140689 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.140815 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.142580 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:02.142586 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:02.142590 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:02.142612 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:02.142656 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:02.142675 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:02.142760 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.143037 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.143158 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":249,"threads_started":1}
I20260806 19:33:02.144959 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.131285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:42339 (local address 127.17.18.67:47999)
0806 19:33:02.132504 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.132551 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.134426 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.135448 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.135463 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.135616 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:02.136706 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.136751 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.138107 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.138112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.140048 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.140075 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.140973 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.140982 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.141229 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.142138 (+ 909us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:02.142141 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:02.142207 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:02.142313 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:02.142789 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:02.142801 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:02.142809 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.143000 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.143493 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":422,"threads_started":1}
I20260806 19:33:02.147007 11881 heartbeater.cc:347] Connected to a master server at 127.17.18.126:42339
I20260806 19:33:02.147436 11881 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:02.149189 11881 heartbeater.cc:511] Master 127.17.18.126:42339 requested a full tablet report, sending...
I20260806 19:33:02.151441 11201 ts_manager.cc:194] Registered new tserver with Master: 6a6f5b13c8fe46119524a3f306f22274 (127.17.18.67:42173)
I20260806 19:33:02.152484 11201 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.67:47999
I20260806 19:33:02.153198 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:33:02.167475 11884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.159225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.17.18.126:42339)
0806 19:33:02.159451 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.159457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.159982 (+ 525us) server_negotiation.cc:407] Connection header received
0806 19:33:02.160127 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.160132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.160208 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.160307 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:02.161140 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.162389 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.164225 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.164766 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.164898 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.166385 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:02.166391 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:02.166395 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:02.166418 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:02.166459 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:02.166472 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:02.166566 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.166932 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.167105 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 19:33:02.172959 11201 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:33:02.183120 11201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:33:02.220789 11900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.197689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:46561 (local address 127.0.0.1:47018)
0806 19:33:02.209677 (+ 11988us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.209698 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.209825 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.212609 (+ 2784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.212614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.212645 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:02.213031 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.213044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.215182 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.215188 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.217455 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.217471 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.219507 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.219518 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.219935 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.219973 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.220103 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.220375 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11827,"mutex_wait_us":161,"thread_start_us":16617,"threads_started":1}
I20260806 19:33:02.220883 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.197541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.17.18.66:36483)
0806 19:33:02.210450 (+ 12909us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.210462 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.210499 (+ 37us) server_negotiation.cc:407] Connection header received
0806 19:33:02.210616 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.210624 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.210938 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.211172 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:02.212344 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.213973 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.217249 (+ 3276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.218908 (+ 1659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.219080 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.219380 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.220309 (+ 929us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.220503 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12740,"thread_start_us":12602,"threads_started":1}
I20260806 19:33:02.221271 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.199051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47018 (local address 127.17.18.65:46561)
0806 19:33:02.210879 (+ 11828us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.210887 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.210917 (+ 30us) server_negotiation.cc:407] Connection header received
0806 19:33:02.211010 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.211017 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.211264 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.213259 (+ 1995us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:02.213562 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.215057 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.217736 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.219225 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.219737 (+ 512us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.220052 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.220146 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.220512 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11635,"thread_start_us":11437,"threads_started":1}
I20260806 19:33:02.221619 11905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.197449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:36483 (local address 127.0.0.1:38580)
0806 19:33:02.208899 (+ 11450us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.208964 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.209208 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.211553 (+ 2345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.211562 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.211599 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:02.212077 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.212093 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.214160 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.214171 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.216929 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.216948 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.219539 (+ 2591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.219545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.219883 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.219950 (+ 67us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.220124 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.221228 (+ 1104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11115,"mutex_wait_us":962,"thread_start_us":11922,"threads_started":1}
I20260806 19:33:02.226186 11902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.197913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:42173 (local address 127.0.0.1:38874)
0806 19:33:02.214660 (+ 16747us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.214681 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.214818 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.215588 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.215593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.215621 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:02.216121 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.216132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.218174 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.218179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.220363 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.220379 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.225065 (+ 4686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.225074 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.225297 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.225340 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.225504 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.225677 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16592,"mutex_wait_us":143,"thread_start_us":10452,"threads_started":1}
I20260806 19:33:02.225576 11593 tablet_service.cc:1467] Processing CreateTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b (DEFAULT_TABLE table=test-table [id=14c66003519e45159d7cf2c727351abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:02.225553 11398 tablet_service.cc:1467] Processing CreateTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b (DEFAULT_TABLE table=test-table [id=14c66003519e45159d7cf2c727351abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:02.226873 11906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.198360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38874 (local address 127.17.18.67:42173)
0806 19:33:02.212463 (+ 14103us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.212473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.214967 (+ 2494us) server_negotiation.cc:407] Connection header received
0806 19:33:02.215090 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.215098 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.215373 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.215558 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:02.216339 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.217985 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.220620 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.222207 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.222357 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.224878 (+ 2521us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.225601 (+ 723us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.225940 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13903,"thread_start_us":13732,"threads_started":1}
I20260806 19:33:02.227608 11593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 709e6903fe154df391ab5e4c7c33bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:02.227634 11398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 709e6903fe154df391ab5e4c7c33bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:02.231535 11785 tablet_service.cc:1467] Processing CreateTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b (DEFAULT_TABLE table=test-table [id=14c66003519e45159d7cf2c727351abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:02.233431 11785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 709e6903fe154df391ab5e4c7c33bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:02.241000 11908 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Bootstrap starting.
I20260806 19:33:02.243659 11909 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Bootstrap starting.
I20260806 19:33:02.245221 11908 tablet_bootstrap.cc:654] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:02.246769 11908 log.cc:824] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:02.247697 11909 tablet_bootstrap.cc:654] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:02.249262 11909 log.cc:824] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:02.249575 11913 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Bootstrap starting.
I20260806 19:33:02.253405 11909 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: No bootstrap required, opened a new log
I20260806 19:33:02.253628 11908 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: No bootstrap required, opened a new log
I20260806 19:33:02.253749 11909 ts_tablet_manager.cc:1397] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260806 19:33:02.253885 11913 tablet_bootstrap.cc:654] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:02.253937 11908 ts_tablet_manager.cc:1397] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.003s
I20260806 19:33:02.255934 11913 log.cc:824] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:02.261993 11909 raft_consensus.cc:348] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.262555 11909 raft_consensus.cc:374] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:02.262670 11909 raft_consensus.cc:729] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98bb7e0590b74e689f6bc20636bac42d, State: Initialized, Role: FOLLOWER
I20260806 19:33:02.263424 11909 consensus_queue.cc:260] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.264899 11913 tablet_bootstrap.cc:492] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: No bootstrap required, opened a new log
I20260806 19:33:02.265259 11913 ts_tablet_manager.cc:1397] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.012s
I20260806 19:33:02.265163 11908 raft_consensus.cc:348] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.265664 11909 ts_tablet_manager.cc:1428] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260806 19:33:02.265759 11908 raft_consensus.cc:374] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:02.265867 11908 raft_consensus.cc:729] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f4c5cc24554f3e9389c19e7f5e0fcb, State: Initialized, Role: FOLLOWER
I20260806 19:33:02.266683 11908 consensus_queue.cc:260] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.268879 11684 heartbeater.cc:503] Master 127.17.18.126:42339 was elected leader, sending a full tablet report...
I20260806 19:33:02.269941 11908 ts_tablet_manager.cc:1428] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260806 19:33:02.276033 11913 raft_consensus.cc:348] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.276469 11913 raft_consensus.cc:374] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:02.276576 11913 raft_consensus.cc:729] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a6f5b13c8fe46119524a3f306f22274, State: Initialized, Role: FOLLOWER
I20260806 19:33:02.277281 11913 consensus_queue.cc:260] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.278653 11881 heartbeater.cc:503] Master 127.17.18.126:42339 was elected leader, sending a full tablet report...
I20260806 19:33:02.278676 11916 raft_consensus.cc:482] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:33:02.279198 11913 ts_tablet_manager.cc:1428] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Time spent starting tablet: real 0.014s user 0.007s sys 0.007s
I20260806 19:33:02.278991 11916 raft_consensus.cc:504] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.281226 11916 leader_election.cc:288] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27f4c5cc24554f3e9389c19e7f5e0fcb (127.17.18.66:36483), 6a6f5b13c8fe46119524a3f306f22274 (127.17.18.67:42173)
I20260806 19:33:02.289811 11922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.281506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:42173 (local address 127.17.18.65:40395)
0806 19:33:02.283662 (+ 2156us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.283682 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.283854 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.284353 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.284358 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.284387 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:02.284797 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.284811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.285905 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.285910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.287620 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.287639 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.289013 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.289020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.289198 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.289235 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.289327 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.289512 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2011,"thread_start_us":2595,"threads_started":1}
I20260806 19:33:02.289862 11906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.282277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:40395 (local address 127.17.18.67:42173)
0806 19:33:02.282452 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.282457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.283812 (+ 1355us) server_negotiation.cc:407] Connection header received
0806 19:33:02.284031 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.284038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.284121 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.284204 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:02.284931 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.285767 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.287857 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.288803 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.288951 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.289006 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.289436 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.289582 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 19:33:02.290225 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.281748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:59585 (local address 127.17.18.66:36483)
0806 19:33:02.281981 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.281987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.284574 (+ 2587us) server_negotiation.cc:407] Connection header received
0806 19:33:02.284726 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.284731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.284823 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.284910 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:02.285490 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.286386 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.288265 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.289158 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.289329 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.289426 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.289819 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.289960 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 19:33:02.290886 11920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.281791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:36483 (local address 127.17.18.65:59585)
0806 19:33:02.284432 (+ 2641us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:02.284460 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:02.284601 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:02.284974 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:02.284978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:02.285005 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:02.285296 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.285304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.286544 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.286548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.288045 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:02.288061 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.289430 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.289437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:02.289633 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.289670 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 19:33:02.289765 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 19:33:02.289906 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2509,"thread_start_us":1517,"threads_started":1}
I20260806 19:33:02.291221 11809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709e6903fe154df391ab5e4c7c33bc5b" candidate_uuid: "98bb7e0590b74e689f6bc20636bac42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a6f5b13c8fe46119524a3f306f22274" is_pre_election: true
I20260806 19:33:02.291913 11809 raft_consensus.cc:2454] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98bb7e0590b74e689f6bc20636bac42d in term 0.
I20260806 19:33:02.291944 11621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709e6903fe154df391ab5e4c7c33bc5b" candidate_uuid: "98bb7e0590b74e689f6bc20636bac42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" is_pre_election: true
I20260806 19:33:02.292522 11621 raft_consensus.cc:2454] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98bb7e0590b74e689f6bc20636bac42d in term 0.
I20260806 19:33:02.292770 11318 leader_election.cc:302] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a6f5b13c8fe46119524a3f306f22274, 98bb7e0590b74e689f6bc20636bac42d; no voters:
I20260806 19:33:02.293249 11916 raft_consensus.cc:2781] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:33:02.293427 11916 raft_consensus.cc:482] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:33:02.293553 11916 raft_consensus.cc:3037] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:02.296216 11916 raft_consensus.cc:504] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.296998 11916 leader_election.cc:288] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [CANDIDATE]: Term 1 election: Requested vote from peers 27f4c5cc24554f3e9389c19e7f5e0fcb (127.17.18.66:36483), 6a6f5b13c8fe46119524a3f306f22274 (127.17.18.67:42173)
I20260806 19:33:02.297600 11621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709e6903fe154df391ab5e4c7c33bc5b" candidate_uuid: "98bb7e0590b74e689f6bc20636bac42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb"
I20260806 19:33:02.297658 11809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709e6903fe154df391ab5e4c7c33bc5b" candidate_uuid: "98bb7e0590b74e689f6bc20636bac42d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a6f5b13c8fe46119524a3f306f22274"
I20260806 19:33:02.297863 11621 raft_consensus.cc:3037] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:02.297892 11809 raft_consensus.cc:3037] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:02.300714 11809 raft_consensus.cc:2454] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98bb7e0590b74e689f6bc20636bac42d in term 1.
I20260806 19:33:02.300722 11621 raft_consensus.cc:2454] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98bb7e0590b74e689f6bc20636bac42d in term 1.
I20260806 19:33:02.301244 11318 leader_election.cc:302] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a6f5b13c8fe46119524a3f306f22274, 98bb7e0590b74e689f6bc20636bac42d; no voters:
I20260806 19:33:02.301703 11916 raft_consensus.cc:2781] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:02.302251 11916 raft_consensus.cc:686] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 1 LEADER]: Becoming Leader. State: Replica: 98bb7e0590b74e689f6bc20636bac42d, State: Running, Role: LEADER
I20260806 19:33:02.302799 11916 consensus_queue.cc:237] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } }
I20260806 19:33:02.308099 11200 catalog_manager.cc:5495] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d reported cstate change: term changed from 0 to 1, leader changed from <none> to 98bb7e0590b74e689f6bc20636bac42d (127.17.18.65). New cstate: current_term: 1 leader_uuid: "98bb7e0590b74e689f6bc20636bac42d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98bb7e0590b74e689f6bc20636bac42d" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 } health_report { overall_health: UNKNOWN } } }
W20260806 19:33:02.311883 11490 tablet.cc:2369] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:33:02.332902 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.326785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47024 (local address 127.17.18.65:46561)
0806 19:33:02.326972 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.326976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.326996 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:33:02.327281 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.327285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.327413 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.327563 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:33:02.328006 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.328759 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.330432 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.330884 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.330991 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.331621 (+ 630us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:33:02.332201 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:33:02.332337 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.332586 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.332674 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 19:33:02.339396 11685 tablet.cc:2369] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:33:02.342855 11809 raft_consensus.cc:1261] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 1 FOLLOWER]: Refusing update from remote peer 98bb7e0590b74e689f6bc20636bac42d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:02.342885 11621 raft_consensus.cc:1261] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 1 FOLLOWER]: Refusing update from remote peer 98bb7e0590b74e689f6bc20636bac42d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:02.344027 11923 consensus_queue.cc:1035] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a6f5b13c8fe46119524a3f306f22274" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 42173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:02.344442 11916 consensus_queue.cc:1035] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f4c5cc24554f3e9389c19e7f5e0fcb" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 36483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:02.374092 11200 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:02.374436 11200 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:02.378883 11200 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aae21aa913ea47c0af2d721aa0a55ef3: Sending DeleteTablet for 3 replicas of tablet 709e6903fe154df391ab5e4c7c33bc5b
I20260806 19:33:02.380470 11593 tablet_service.cc:1514] Processing DeleteTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:02 UTC) from {username='slave'} at 127.0.0.1:38580
I20260806 19:33:02.380703 11785 tablet_service.cc:1514] Processing DeleteTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:02 UTC) from {username='slave'} at 127.0.0.1:38874
I20260806 19:33:02.381633 11938 tablet_replica.cc:330] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: stopping tablet replica
I20260806 19:33:02.381819 11939 tablet_replica.cc:330] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: stopping tablet replica
I20260806 19:33:02.382256 11939 raft_consensus.cc:2229] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:02.382740 11398 tablet_service.cc:1514] Processing DeleteTablet for tablet 709e6903fe154df391ab5e4c7c33bc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:02 UTC) from {username='slave'} at 127.0.0.1:47018
I20260806 19:33:02.382862 11939 raft_consensus.cc:2258] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:02.383351 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 11295
I20260806 19:33:02.385955 11938 raft_consensus.cc:2229] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:02.386608 11938 raft_consensus.cc:2258] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:02.388907 11939 ts_tablet_manager.cc:1905] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:02.393342 11940 tablet_replica.cc:330] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: stopping tablet replica
I20260806 19:33:02.393925 11940 raft_consensus.cc:2229] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:33:02.394976 11940 raft_consensus.cc:2258] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:02.397019 11938 ts_tablet_manager.cc:1905] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:02.397634 11940 ts_tablet_manager.cc:1905] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:02.405233 11938 ts_tablet_manager.cc:1918] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:02.406284 11907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.384555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.17.18.65:46561)
0806 19:33:02.384748 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.384753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.396033 (+ 11280us) server_negotiation.cc:407] Connection header received
0806 19:33:02.396379 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.396386 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.396509 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.396589 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:02.397978 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.399384 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.401508 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.402192 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.402312 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.404067 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:02.404080 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:02.404103 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:02.405076 (+ 973us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:02.405150 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:02.405181 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:02.405302 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.405766 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.405894 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:33:02.406631 11940 ts_tablet_manager.cc:1918] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:02.406843 11940 log.cc:1196] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/709e6903fe154df391ab5e4c7c33bc5b
I20260806 19:33:02.407474 11940 ts_tablet_manager.cc:1939] T 709e6903fe154df391ab5e4c7c33bc5b P 98bb7e0590b74e689f6bc20636bac42d: Deleting consensus metadata
I20260806 19:33:02.408099 11480 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:02.408476 11939 ts_tablet_manager.cc:1918] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:02.408670 11939 log.cc:1196] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/709e6903fe154df391ab5e4c7c33bc5b
I20260806 19:33:02.409353 11939 ts_tablet_manager.cc:1939] T 709e6903fe154df391ab5e4c7c33bc5b P 6a6f5b13c8fe46119524a3f306f22274: Deleting consensus metadata
I20260806 19:33:02.409858 11938 log.cc:1196] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/709e6903fe154df391ab5e4c7c33bc5b
I20260806 19:33:02.410486 11938 ts_tablet_manager.cc:1939] T 709e6903fe154df391ab5e4c7c33bc5b P 27f4c5cc24554f3e9389c19e7f5e0fcb: Deleting consensus metadata
I20260806 19:33:02.411676 11180 catalog_manager.cc:4841] TS 6a6f5b13c8fe46119524a3f306f22274 (127.17.18.67:42173): tablet 709e6903fe154df391ab5e4c7c33bc5b (table test-table [id=14c66003519e45159d7cf2c727351abd]) successfully deleted
I20260806 19:33:02.412649 11177 catalog_manager.cc:4841] TS 27f4c5cc24554f3e9389c19e7f5e0fcb (127.17.18.66:36483): tablet 709e6903fe154df391ab5e4c7c33bc5b (table test-table [id=14c66003519e45159d7cf2c727351abd]) successfully deleted
I20260806 19:33:02.511037 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 11295
I20260806 19:33:02.511356 11181 catalog_manager.cc:4841] TS 98bb7e0590b74e689f6bc20636bac42d (127.17.18.65:46561): tablet 709e6903fe154df391ab5e4c7c33bc5b (table test-table [id=14c66003519e45159d7cf2c727351abd]) successfully deleted
I20260806 19:33:02.542692 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 11493
I20260806 19:33:02.549677 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.543474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.17.18.66:36483)
0806 19:33:02.543656 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.543661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.543682 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:02.543874 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.543878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.543962 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.544052 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:02.544498 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.545278 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.546681 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.547108 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.547221 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.548255 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:02.548264 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:02.548280 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:02.548885 (+ 605us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:02.548936 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:02.548958 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:02.549058 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.549200 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.549323 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 19:33:02.550372 11678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:02.641776 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 11493
I20260806 19:33:02.670861 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 11691
I20260806 19:33:02.678198 11906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:02.671736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.17.18.67:42173)
0806 19:33:02.671925 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:02.671930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:02.671951 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:02.672062 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:02.672066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:02.672175 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:02.672290 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:02.672683 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.673683 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.675042 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:02.675466 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:02.675569 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:02.676650 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:02.676661 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:02.676680 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:02.677399 (+ 719us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:02.677463 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:02.677494 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:02.677593 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:02.677761 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 19:33:02.677870 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:33:02.678936 11876 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:02.770752 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 11691
I20260806 19:33:02.796864 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 11158
I20260806 19:33:02.798074 11251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:02.914544 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 11158
2026-08-06T19:33:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3073 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:03 dist-test-slave-f0tn krb5kdc[11951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:03 dist-test-slave-f0tn krb5kdc[11951](info): set up 2 sockets
Aug 06 19:33:03 dist-test-slave-f0tn krb5kdc[11951](info): commencing operation
krb5kdc: starting...
W20260806 19:33:04.168130 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:04 dist-test-slave-f0tn krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:04.537983 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:46791
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:46791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:04.915629 11969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:04.915978 11969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:04.916100 11969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:04.923806 11969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:04.923946 11969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:04.924000 11969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:04.924083 11969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:04.924151 11969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:04.934764 11969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:46791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:46791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:04.936291 11969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:04.937749 11969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:04.950721 11983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:04.950778 11980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:04.950796 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:04.951752 11969 server_base.cc:1034] running on GCE node
I20260806 19:33:04.952629 11969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:04.954418 11969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:04.955687 11969 hybrid_clock.cc:648] HybridClock initialized: now 1786044784955629 us; error 50 us; skew 500 ppm
I20260806 19:33:04.956115 11969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:04 dist-test-slave-f0tn krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:04.964340 11969 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:04.966346 11969 webserver.cc:460] Webserver started at http://127.17.18.126:34779/ using document root <none> and password file <none>
I20260806 19:33:04.967193 11969 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:04.967325 11969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:04.967706 11969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:04.971163 11969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "a19ef2a8e1a14139b086577b0ec1de87"
format_stamp: "Formatted at 2026-08-06 19:33:04 on dist-test-slave-f0tn"
server_key: "ea721bd2176c0603cca6268e446b6638"
server_key_iv: "9cf6bb80c9a3c5727f47a7147b4e3d29"
server_key_version: "encryptionkey@0"
I20260806 19:33:04.972008 11969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "a19ef2a8e1a14139b086577b0ec1de87"
format_stamp: "Formatted at 2026-08-06 19:33:04 on dist-test-slave-f0tn"
server_key: "ea721bd2176c0603cca6268e446b6638"
server_key_iv: "9cf6bb80c9a3c5727f47a7147b4e3d29"
server_key_version: "encryptionkey@0"
I20260806 19:33:04.978076 11969 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:33:04.982168 11995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:04.983719 11969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260806 19:33:04.983919 11969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "a19ef2a8e1a14139b086577b0ec1de87"
format_stamp: "Formatted at 2026-08-06 19:33:04 on dist-test-slave-f0tn"
server_key: "ea721bd2176c0603cca6268e446b6638"
server_key_iv: "9cf6bb80c9a3c5727f47a7147b4e3d29"
server_key_version: "encryptionkey@0"
I20260806 19:33:04.984170 11969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:05.018867 11969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:05.024061 11969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:05.024457 11969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:05.046100 11969 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:46791
I20260806 19:33:05.046166 12073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:46791 every 8 connection(s)
I20260806 19:33:05.047564 11969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:05.051869 12074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:05.055301 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 11969
I20260806 19:33:05.055495 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:05.055967 17481 external_mini_cluster.cc:1428] Setting key c05831f83d462c29e68c0ca46e414c12
I20260806 19:33:05.065580 12074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: Bootstrap starting.
I20260806 19:33:05.069159 12074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:05.070402 12074 log.cc:824] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:33:05 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:05.074476 12074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: No bootstrap required, opened a new log
I20260806 19:33:05.083333 12078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:05.058336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36278 (local address 127.17.18.126:46791)
0806 19:33:05.059335 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:05.059348 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:05.059398 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:33:05.061536 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:05.061567 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:05.062103 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:05.062597 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:05.064293 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.065802 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.067322 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.068250 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.068462 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:05.073666 (+ 5204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:05.073675 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:05.073704 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:05.073750 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:05.077437 (+ 3687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:05.078657 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:05.078667 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:05.078676 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:05.078937 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:05.079510 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:05.079515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:05.079517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:05.080294 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:05.080579 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:05.081201 (+ 622us) server_negotiation.cc:299] Negotiation successful
0806 19:33:05.081802 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":444,"threads_started":1}
I20260806 19:33:05.085237 12074 raft_consensus.cc:348] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } }
I20260806 19:33:05.085769 12074 raft_consensus.cc:374] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:05.085897 12074 raft_consensus.cc:729] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a19ef2a8e1a14139b086577b0ec1de87, State: Initialized, Role: FOLLOWER
I20260806 19:33:05.086628 12074 consensus_queue.cc:260] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } }
I20260806 19:33:05.087003 12074 raft_consensus.cc:388] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:05.087193 12074 raft_consensus.cc:482] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:05.087404 12074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:05.090217 12074 raft_consensus.cc:504] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } }
I20260806 19:33:05.090797 12074 leader_election.cc:302] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a19ef2a8e1a14139b086577b0ec1de87; no voters:
I20260806 19:33:05.091473 12074 leader_election.cc:288] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:05.091660 12082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:05.092520 12082 raft_consensus.cc:686] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [term 1 LEADER]: Becoming Leader. State: Replica: a19ef2a8e1a14139b086577b0ec1de87, State: Running, Role: LEADER
I20260806 19:33:05.093216 12082 consensus_queue.cc:237] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } }
I20260806 19:33:05.094375 12074 sys_catalog.cc:564] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:05.096693 12083 sys_catalog.cc:455] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a19ef2a8e1a14139b086577b0ec1de87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } } }
I20260806 19:33:05.097216 12083 sys_catalog.cc:458] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:05.098160 12085 sys_catalog.cc:455] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a19ef2a8e1a14139b086577b0ec1de87. Latest consensus state: current_term: 1 leader_uuid: "a19ef2a8e1a14139b086577b0ec1de87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a19ef2a8e1a14139b086577b0ec1de87" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46791 } } }
I20260806 19:33:05.098898 12085 sys_catalog.cc:458] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:05.099548 12095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:05.105540 12095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:05.115685 12095 catalog_manager.cc:1347] Generated new cluster ID: 7d1eeb510cd24a6585518ccf5bf21c29
I20260806 19:33:05.115845 12095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:05.126173 12095 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:05.127727 12095 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:05.143465 12095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: Generated new TSK 0
I20260806 19:33:05.144853 12095 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:33:05.253821 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:05.633245 12121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:05.633613 12121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:05.633749 12121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:05.641516 12121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:05.641650 12121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:05.641816 12121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:33:05.652276 12121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:05.653775 12121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:05.655218 12121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:05.670003 12129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:05.670039 12135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:05.670069 12127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:05.670893 12121 server_base.cc:1034] running on GCE node
I20260806 19:33:05.671593 12121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:05.672636 12121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:05.673875 12121 hybrid_clock.cc:648] HybridClock initialized: now 1786044785673815 us; error 44 us; skew 500 ppm
I20260806 19:33:05.674289 12121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:05 dist-test-slave-f0tn krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044785, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:05.677820 12121 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:33:05.679634 12121 webserver.cc:460] Webserver started at http://127.17.18.65:33195/ using document root <none> and password file <none>
I20260806 19:33:05.680408 12121 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:05.680539 12121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:05.680886 12121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:05.684168 12121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "a84ed1efadc44964ae6c1567b30e5ba0"
format_stamp: "Formatted at 2026-08-06 19:33:05 on dist-test-slave-f0tn"
server_key: "c4cf7f736dd75aea130e7fe77131e94e"
server_key_iv: "d7a383b18124f3c6bf6ed41f47dc83ea"
server_key_version: "encryptionkey@0"
I20260806 19:33:05.685026 12121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "a84ed1efadc44964ae6c1567b30e5ba0"
format_stamp: "Formatted at 2026-08-06 19:33:05 on dist-test-slave-f0tn"
server_key: "c4cf7f736dd75aea130e7fe77131e94e"
server_key_iv: "d7a383b18124f3c6bf6ed41f47dc83ea"
server_key_version: "encryptionkey@0"
I20260806 19:33:05.690961 12121 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 19:33:05.694905 12144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:05.696448 12121 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:05.696641 12121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "a84ed1efadc44964ae6c1567b30e5ba0"
format_stamp: "Formatted at 2026-08-06 19:33:05 on dist-test-slave-f0tn"
server_key: "c4cf7f736dd75aea130e7fe77131e94e"
server_key_iv: "d7a383b18124f3c6bf6ed41f47dc83ea"
server_key_version: "encryptionkey@0"
I20260806 19:33:05.696852 12121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:05.711743 12121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:05.716430 12121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:05.716740 12121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:05.717911 12121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:05.719467 12121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:05.719547 12121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:05.719667 12121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:05.719725 12121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:05.753841 12121 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:34043
I20260806 19:33:05.753885 12321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:34043 every 8 connection(s)
I20260806 19:33:05.755227 12121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:33:05.761873 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 12121
I20260806 19:33:05.762107 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:33:05.762660 17481 external_mini_cluster.cc:1428] Setting key eee5555947fd70c0392455cd5b1bc364
Aug 06 19:33:05 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044785, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:05.777762 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:05.758093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48729 (local address 127.17.18.126:46791)
0806 19:33:05.758628 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:05.758634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:05.759713 (+ 1079us) server_negotiation.cc:407] Connection header received
0806 19:33:05.761985 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:05.761992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:05.762097 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:05.762233 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:05.764053 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.764845 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.766599 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.767036 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.767178 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:05.771180 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:05.771186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:05.771189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:05.771229 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:05.774010 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:05.774945 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:05.774950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:05.774953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:05.775111 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:05.775621 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:05.775625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:05.775628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:05.775938 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:05.776091 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:05.777016 (+ 925us) server_negotiation.cc:299] Negotiation successful
0806 19:33:05.777324 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":272,"threads_started":1}
I20260806 19:33:05.779168 12326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:05.758707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:46791 (local address 127.17.18.65:48729)
0806 19:33:05.759524 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:05.759577 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:05.761599 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:05.762499 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:05.762508 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:05.763157 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:05.763860 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:05.763884 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.765015 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.765019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:05.766432 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:05.766448 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:05.767317 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:05.767326 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:05.767585 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:05.768273 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:05.768299 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:05.770891 (+ 2592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:05.774230 (+ 3339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:05.774241 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:05.774258 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:05.774777 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:05.775240 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:05.775244 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:05.775246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:05.775483 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:05.776091 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:05.776101 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:05.776534 (+ 433us) client_negotiation.cc:769] Sending connection context
0806 19:33:05.776824 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 19:33:05.777582 (+ 758us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":322,"threads_started":1}
I20260806 19:33:05.781563 12323 heartbeater.cc:347] Connected to a master server at 127.17.18.126:46791
I20260806 19:33:05.781975 12323 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:05.782964 12323 heartbeater.cc:511] Master 127.17.18.126:46791 requested a full tablet report, sending...
I20260806 19:33:05.786163 12024 ts_manager.cc:194] Registered new tserver with Master: a84ed1efadc44964ae6c1567b30e5ba0 (127.17.18.65:34043)
I20260806 19:33:05.788568 12024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:48729
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:33:05.846535 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:06.238600 12329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:06.239076 12329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:06.239194 12329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:06.247429 12329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:06.247607 12329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:06.247733 12329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:33:06.259071 12329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:06.260459 12329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:06.261932 12329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:06.277216 12335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:06.277151 12338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:06.277249 12343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:06.277946 12329 server_base.cc:1034] running on GCE node
I20260806 19:33:06.278759 12329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:06.279870 12329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:06.281111 12329 hybrid_clock.cc:648] HybridClock initialized: now 1786044786281061 us; error 40 us; skew 500 ppm
I20260806 19:33:06.281538 12329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:06 dist-test-slave-f0tn krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:06.285058 12329 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:33:06.287668 12329 webserver.cc:460] Webserver started at http://127.17.18.66:38643/ using document root <none> and password file <none>
I20260806 19:33:06.288976 12329 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:06.289228 12329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:06.289748 12329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:06.293107 12329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "b82554c31c0d97f5ce88b8d14abc872d"
server_key_iv: "7edae40a722e1c9bb4039fcaccd1d26a"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.294020 12329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "b82554c31c0d97f5ce88b8d14abc872d"
server_key_iv: "7edae40a722e1c9bb4039fcaccd1d26a"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.300360 12329 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:33:06.305312 12356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:06.306934 12329 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:33:06.307140 12329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "b82554c31c0d97f5ce88b8d14abc872d"
server_key_iv: "7edae40a722e1c9bb4039fcaccd1d26a"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.307392 12329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:06.328670 12329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:06.333544 12329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:06.333863 12329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:06.334939 12329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:06.336499 12329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:06.336585 12329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:06.336740 12329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:06.336798 12329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:06.371145 12329 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:38539
I20260806 19:33:06.371220 12515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:38539 every 8 connection(s)
I20260806 19:33:06.372663 12329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:33:06.376264 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 12329
I20260806 19:33:06.376487 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:33:06.377067 17481 external_mini_cluster.cc:1428] Setting key 920f7ee93627bddfe4a292fb6096ad07
Aug 06 19:33:06 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:06.395435 12520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:06.375404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:57803 (local address 127.17.18.126:46791)
0806 19:33:06.375912 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:06.375916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:06.377020 (+ 1104us) server_negotiation.cc:407] Connection header received
0806 19:33:06.379201 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:06.379206 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:06.379293 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:06.379416 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:06.381220 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.382305 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:06.384040 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.384607 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:06.384736 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:06.388482 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:06.388488 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:06.388514 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:06.388555 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:06.391864 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:06.392706 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:06.392711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:06.392714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:06.392870 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:06.393278 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:06.393283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:06.393285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:06.393679 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:06.393830 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:06.394858 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0806 19:33:06.395054 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":254,"threads_started":1}
I20260806 19:33:06.396831 12523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:06.375954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:46791 (local address 127.17.18.66:57803)
0806 19:33:06.376844 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:06.376891 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:06.378846 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:06.379703 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:06.379712 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:06.380328 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:06.380973 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:06.380994 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.382512 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:06.382517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:06.383866 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:06.383881 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.384854 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:06.384859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:06.385073 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:06.385826 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:06.385855 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:06.388222 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:06.392049 (+ 3827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:06.392057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:06.392074 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:06.392568 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:06.392968 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:06.392971 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:06.392974 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:06.393174 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:06.393836 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:06.393843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:06.394417 (+ 574us) client_negotiation.cc:769] Sending connection context
0806 19:33:06.394777 (+ 360us) client_negotiation.cc:240] Negotiation successful
0806 19:33:06.395435 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":387,"threads_started":1}
I20260806 19:33:06.398521 12517 heartbeater.cc:347] Connected to a master server at 127.17.18.126:46791
I20260806 19:33:06.398864 12517 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:06.399698 12517 heartbeater.cc:511] Master 127.17.18.126:46791 requested a full tablet report, sending...
I20260806 19:33:06.401355 12024 ts_manager.cc:194] Registered new tserver with Master: dbfb4658b6984c2aa1ea60349a4c0f7d (127.17.18.66:38539)
I20260806 19:33:06.402281 12024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:57803
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:33:06.457795 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:33:06.792680 12323 heartbeater.cc:503] Master 127.17.18.126:46791 was elected leader, sending a full tablet report...
W20260806 19:33:06.860524 12527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:06.860858 12527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:06.860957 12527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:06.869711 12527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:06.869858 12527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:06.869988 12527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:33:06.880748 12527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:46791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:06.882254 12527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:06.883729 12527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:06.898097 12537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:06.898161 12538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:06.898475 12540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:06.899238 12527 server_base.cc:1034] running on GCE node
I20260806 19:33:06.900100 12527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:06.901814 12527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:06.903146 12527 hybrid_clock.cc:648] HybridClock initialized: now 1786044786903070 us; error 72 us; skew 500 ppm
I20260806 19:33:06.903530 12527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:06 dist-test-slave-f0tn krb5kdc[11951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:06.907228 12527 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:33:06.908982 12527 webserver.cc:460] Webserver started at http://127.17.18.67:46675/ using document root <none> and password file <none>
I20260806 19:33:06.909847 12527 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:06.909991 12527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:06.910334 12527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:06.914078 12527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "864647c097d14a038fc72d7d5c0cd5aa"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "47054381bb2cb70911a339ee0885d84e"
server_key_iv: "ff52c40fe25fe26ddbf6cd9f001d5990"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.915012 12527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "864647c097d14a038fc72d7d5c0cd5aa"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "47054381bb2cb70911a339ee0885d84e"
server_key_iv: "ff52c40fe25fe26ddbf6cd9f001d5990"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.921963 12527 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:33:06.926930 12550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:06.928635 12527 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260806 19:33:06.928849 12527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "864647c097d14a038fc72d7d5c0cd5aa"
format_stamp: "Formatted at 2026-08-06 19:33:06 on dist-test-slave-f0tn"
server_key: "47054381bb2cb70911a339ee0885d84e"
server_key_iv: "ff52c40fe25fe26ddbf6cd9f001d5990"
server_key_version: "encryptionkey@0"
I20260806 19:33:06.929080 12527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:06.945628 12527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:06.950453 12527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:06.950755 12527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:06.951815 12527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:06.953368 12527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:06.953490 12527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 19:33:06.953616 12527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:06.953678 12527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:06.986871 12527 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:41433
I20260806 19:33:06.986918 12720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:41433 every 8 connection(s)
I20260806 19:33:06.988251 12527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:33:06.996160 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 12527
I20260806 19:33:06.996345 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:33:06.996809 17481 external_mini_cluster.cc:1428] Setting key 6d2f69ab91069d233b8913c422aff264
Aug 06 19:33:06 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:07.010720 12725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:06.991079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:53559 (local address 127.17.18.126:46791)
0806 19:33:06.991539 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:06.991545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:06.992642 (+ 1097us) server_negotiation.cc:407] Connection header received
0806 19:33:06.994729 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:06.994734 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:06.994817 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:06.994977 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:06.996987 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.998013 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.000065 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.000569 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.000681 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.004514 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:07.004520 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:07.004523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:07.004573 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:07.007365 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.008320 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.008324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.008327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.008463 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.008983 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.008988 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.008991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.009301 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:07.009490 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.010214 (+ 724us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.010415 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":206,"threads_started":1}
I20260806 19:33:07.012135 12728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:06.991646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:46791 (local address 127.17.18.67:53559)
0806 19:33:06.992443 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:06.992492 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:06.994402 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:06.995290 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:06.995304 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:06.996031 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:06.996763 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:06.996785 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:06.998238 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:06.998245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:06.999918 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:06.999935 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.000811 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.000817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.001086 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.001842 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:07.001870 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:07.004247 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:07.007588 (+ 3341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:07.007600 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:07.007623 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:07.008186 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:07.008606 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:07.008616 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:07.008618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:07.008856 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:07.009430 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:07.009439 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:07.009824 (+ 385us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.010082 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.010647 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":311,"threads_started":1}
I20260806 19:33:07.013688 12723 heartbeater.cc:347] Connected to a master server at 127.17.18.126:46791
I20260806 19:33:07.014015 12723 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:07.014806 12723 heartbeater.cc:511] Master 127.17.18.126:46791 requested a full tablet report, sending...
I20260806 19:33:07.016443 12024 ts_manager.cc:194] Registered new tserver with Master: 864647c097d14a038fc72d7d5c0cd5aa (127.17.18.67:41433)
I20260806 19:33:07.017351 12024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:53559
I20260806 19:33:07.025888 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:33:07.044459 12725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.030278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36294 (local address 127.17.18.126:46791)
0806 19:33:07.030516 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.030524 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.030853 (+ 329us) server_negotiation.cc:407] Connection header received
0806 19:33:07.031005 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.031009 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.031082 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.031169 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:07.032664 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.033502 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.035019 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.035444 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.035557 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.038819 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:07.038826 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:07.038831 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:07.038873 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:07.041609 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.042544 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.042548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.042550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.042682 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.043119 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.043122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.043124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.043482 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:07.043680 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.044027 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.044183 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:33:07.048823 12024 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:33:07.056561 12024 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:33:07.082319 12746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.070729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.17.18.67:41433)
0806 19:33:07.072857 (+ 2128us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.072868 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.072908 (+ 40us) server_negotiation.cc:407] Connection header received
0806 19:33:07.073029 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.073038 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.073326 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.074986 (+ 1660us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:07.075288 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.076998 (+ 1710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.079906 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.080982 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.081120 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.081438 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.081770 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.081955 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1945,"thread_start_us":1747,"threads_started":1}
I20260806 19:33:07.082383 12745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.070399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:41433 (local address 127.0.0.1:38088)
0806 19:33:07.071918 (+ 1519us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:07.071956 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:07.072146 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:07.074084 (+ 1938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:07.074092 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:07.074142 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:07.074733 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.074750 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.077209 (+ 2459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.077214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.079696 (+ 2482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.079717 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.081241 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.081248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.081503 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.081548 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.081673 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.081918 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1266,"mutex_wait_us":23,"thread_start_us":3791,"threads_started":1}
I20260806 19:33:07.083287 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.071232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50892 (local address 127.17.18.65:34043)
0806 19:33:07.073988 (+ 2756us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.073997 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.074641 (+ 644us) server_negotiation.cc:407] Connection header received
0806 19:33:07.074978 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.074987 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.075279 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.075445 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:07.076408 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.077882 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.080134 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.081719 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.081880 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.082136 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.082747 (+ 611us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.082936 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2548,"thread_start_us":2371,"threads_started":1}
I20260806 19:33:07.084054 12744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.070563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:34043 (local address 127.0.0.1:50892)
0806 19:33:07.074497 (+ 3934us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:07.074530 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:07.074770 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:07.075621 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:07.075626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:07.075651 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:07.076179 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.076194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.078059 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.078075 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.079950 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.079969 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.082308 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.082316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.082516 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.082549 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.083488 (+ 939us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.083650 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3804,"mutex_wait_us":6,"thread_start_us":935,"threads_started":1}
I20260806 19:33:07.085495 12750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.075515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:38539 (local address 127.0.0.1:56268)
0806 19:33:07.076188 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:07.076203 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:07.076322 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:07.076831 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:07.076835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:07.076859 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:07.077247 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.077259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.079131 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.079136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.081237 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.081254 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.084715 (+ 3461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.084720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.084843 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.084867 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.084950 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.085090 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":4,"thread_start_us":337,"threads_started":1}
I20260806 19:33:07.085573 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.074872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56268 (local address 127.17.18.66:38539)
0806 19:33:07.075475 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.075483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.076317 (+ 834us) server_negotiation.cc:407] Connection header received
0806 19:33:07.076467 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.076473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.076649 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.076820 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:07.077470 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.078974 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.081473 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.084265 (+ 2792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.084408 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.084590 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.085041 (+ 451us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.085219 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":312,"threads_started":1}
I20260806 19:33:07.087392 12623 tablet_service.cc:1467] Processing CreateTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 (DEFAULT_TABLE table=test-table [id=6041b8aada21489787fc9f59da3504a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:07.088027 12230 tablet_service.cc:1467] Processing CreateTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 (DEFAULT_TABLE table=test-table [id=6041b8aada21489787fc9f59da3504a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:07.089594 12230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dedcd186bfe49db93133c6a6f8eaf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:07.089713 12623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dedcd186bfe49db93133c6a6f8eaf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:07.091212 12425 tablet_service.cc:1467] Processing CreateTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 (DEFAULT_TABLE table=test-table [id=6041b8aada21489787fc9f59da3504a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:07.092686 12425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dedcd186bfe49db93133c6a6f8eaf75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:07.105571 12751 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Bootstrap starting.
I20260806 19:33:07.108278 12752 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Bootstrap starting.
I20260806 19:33:07.110229 12753 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Bootstrap starting.
I20260806 19:33:07.110505 12751 tablet_bootstrap.cc:654] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:07.112090 12751 log.cc:824] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:07.113941 12752 tablet_bootstrap.cc:654] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:07.114289 12753 tablet_bootstrap.cc:654] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:07.115208 12752 log.cc:824] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:07.115741 12753 log.cc:824] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:07.116750 12751 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: No bootstrap required, opened a new log
I20260806 19:33:07.117136 12751 ts_tablet_manager.cc:1397] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260806 19:33:07.118739 12753 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: No bootstrap required, opened a new log
I20260806 19:33:07.118889 12752 tablet_bootstrap.cc:492] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: No bootstrap required, opened a new log
I20260806 19:33:07.119055 12753 ts_tablet_manager.cc:1397] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 19:33:07.119205 12752 ts_tablet_manager.cc:1397] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 19:33:07.127399 12753 raft_consensus.cc:348] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.127933 12753 raft_consensus.cc:374] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:07.128043 12753 raft_consensus.cc:729] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 864647c097d14a038fc72d7d5c0cd5aa, State: Initialized, Role: FOLLOWER
I20260806 19:33:07.128775 12753 consensus_queue.cc:260] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.128769 12751 raft_consensus.cc:348] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.129254 12751 raft_consensus.cc:374] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:07.129364 12751 raft_consensus.cc:729] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbfb4658b6984c2aa1ea60349a4c0f7d, State: Initialized, Role: FOLLOWER
I20260806 19:33:07.130163 12723 heartbeater.cc:503] Master 127.17.18.126:46791 was elected leader, sending a full tablet report...
I20260806 19:33:07.130208 12751 consensus_queue.cc:260] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.130584 12752 raft_consensus.cc:348] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.130959 12753 ts_tablet_manager.cc:1428] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260806 19:33:07.131078 12752 raft_consensus.cc:374] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:07.131182 12752 raft_consensus.cc:729] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84ed1efadc44964ae6c1567b30e5ba0, State: Initialized, Role: FOLLOWER
I20260806 19:33:07.131920 12752 consensus_queue.cc:260] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.134524 12752 ts_tablet_manager.cc:1428] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260806 19:33:07.135648 12517 heartbeater.cc:503] Master 127.17.18.126:46791 was elected leader, sending a full tablet report...
I20260806 19:33:07.136631 12751 ts_tablet_manager.cc:1428] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Time spent starting tablet: real 0.019s user 0.011s sys 0.010s
W20260806 19:33:07.240198 12724 tablet.cc:2369] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:33:07.258184 12324 tablet.cc:2369] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:33:07.274784 12762 raft_consensus.cc:482] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:33:07.275137 12762 raft_consensus.cc:504] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.277208 12762 leader_election.cc:288] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 864647c097d14a038fc72d7d5c0cd5aa (127.17.18.67:41433), dbfb4658b6984c2aa1ea60349a4c0f7d (127.17.18.66:38539)
I20260806 19:33:07.284782 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.278809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:48733 (local address 127.17.18.66:38539)
0806 19:33:07.279022 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.279027 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.279219 (+ 192us) server_negotiation.cc:407] Connection header received
0806 19:33:07.279371 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.279376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.279452 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.279563 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:07.280195 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.280907 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.282912 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.283763 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.283942 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.284031 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.284365 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.284508 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:33:07.284828 12746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.277615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:36477 (local address 127.17.18.67:41433)
0806 19:33:07.277827 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.277832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.278430 (+ 598us) server_negotiation.cc:407] Connection header received
0806 19:33:07.278831 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.278837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.278926 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.279001 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:07.279917 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.280677 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.282988 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.283831 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.284018 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.284102 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.284419 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.284574 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:33:07.284942 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.278459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:38539 (local address 127.17.18.65:48733)
0806 19:33:07.279116 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:07.279131 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:07.279253 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:07.279628 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:07.279632 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:07.279655 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:07.279991 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.279998 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.281062 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.281066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.282705 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.282725 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.284037 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.284044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.284196 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.284222 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.284314 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.284464 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":4,"thread_start_us":306,"threads_started":1}
I20260806 19:33:07.284999 12763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.277629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:41433 (local address 127.17.18.65:36477)
0806 19:33:07.278301 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:07.278317 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:07.278492 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:07.279222 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:07.279227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:07.279334 (+ 107us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:07.279748 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.279764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.280834 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.280840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.282784 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:07.282800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.284103 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.284109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:07.284256 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.284281 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:33:07.284364 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 19:33:07.284505 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":34,"spinlock_wait_cycles":26880,"thread_start_us":358,"threads_started":1}
I20260806 19:33:07.286149 12650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dedcd186bfe49db93133c6a6f8eaf75" candidate_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "864647c097d14a038fc72d7d5c0cd5aa" is_pre_election: true
I20260806 19:33:07.286146 12450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dedcd186bfe49db93133c6a6f8eaf75" candidate_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" is_pre_election: true
I20260806 19:33:07.286674 12650 raft_consensus.cc:2454] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a84ed1efadc44964ae6c1567b30e5ba0 in term 0.
I20260806 19:33:07.286671 12450 raft_consensus.cc:2454] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a84ed1efadc44964ae6c1567b30e5ba0 in term 0.
I20260806 19:33:07.287505 12147 leader_election.cc:302] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 864647c097d14a038fc72d7d5c0cd5aa, a84ed1efadc44964ae6c1567b30e5ba0; no voters:
I20260806 19:33:07.287966 12762 raft_consensus.cc:2781] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:33:07.288149 12762 raft_consensus.cc:482] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:33:07.288275 12762 raft_consensus.cc:3037] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:07.290932 12762 raft_consensus.cc:504] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.291657 12762 leader_election.cc:288] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [CANDIDATE]: Term 1 election: Requested vote from peers 864647c097d14a038fc72d7d5c0cd5aa (127.17.18.67:41433), dbfb4658b6984c2aa1ea60349a4c0f7d (127.17.18.66:38539)
I20260806 19:33:07.292408 12450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dedcd186bfe49db93133c6a6f8eaf75" candidate_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d"
I20260806 19:33:07.292398 12650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dedcd186bfe49db93133c6a6f8eaf75" candidate_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "864647c097d14a038fc72d7d5c0cd5aa"
I20260806 19:33:07.292649 12450 raft_consensus.cc:3037] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:07.292650 12650 raft_consensus.cc:3037] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:07.295357 12450 raft_consensus.cc:2454] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a84ed1efadc44964ae6c1567b30e5ba0 in term 1.
I20260806 19:33:07.295357 12650 raft_consensus.cc:2454] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a84ed1efadc44964ae6c1567b30e5ba0 in term 1.
I20260806 19:33:07.295914 12147 leader_election.cc:302] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a84ed1efadc44964ae6c1567b30e5ba0, dbfb4658b6984c2aa1ea60349a4c0f7d; no voters:
I20260806 19:33:07.296307 12762 raft_consensus.cc:2781] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:07.296845 12762 raft_consensus.cc:686] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 1 LEADER]: Becoming Leader. State: Replica: a84ed1efadc44964ae6c1567b30e5ba0, State: Running, Role: LEADER
I20260806 19:33:07.297418 12762 consensus_queue.cc:237] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } }
I20260806 19:33:07.303375 12024 catalog_manager.cc:5495] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a84ed1efadc44964ae6c1567b30e5ba0 (127.17.18.65). New cstate: current_term: 1 leader_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a84ed1efadc44964ae6c1567b30e5ba0" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 34043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 } health_report { overall_health: UNKNOWN } } }
I20260806 19:33:07.330588 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.323707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50902 (local address 127.17.18.65:34043)
0806 19:33:07.323924 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.323929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.324084 (+ 155us) server_negotiation.cc:407] Connection header received
0806 19:33:07.324354 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.324359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.324475 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.324650 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:33:07.325205 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.326037 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.327756 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.328262 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.328377 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.329119 (+ 742us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:33:07.329744 (+ 625us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:33:07.329911 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.330238 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.330307 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:33:07.340102 12650 raft_consensus.cc:1261] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 1 FOLLOWER]: Refusing update from remote peer a84ed1efadc44964ae6c1567b30e5ba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:07.340104 12450 raft_consensus.cc:1261] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 1 FOLLOWER]: Refusing update from remote peer a84ed1efadc44964ae6c1567b30e5ba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:07.341177 12762 consensus_queue.cc:1035] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "864647c097d14a038fc72d7d5c0cd5aa" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 41433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:07.341625 12766 consensus_queue.cc:1035] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbfb4658b6984c2aa1ea60349a4c0f7d" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 38539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:07.352656 12769 mvcc.cc:205] Tried to move back new op lower bound from 7315639448933437440 to 7315639448774451200. Current Snapshot: MvccSnapshot[applied={T|T < 7315639448933437440}]
I20260806 19:33:07.353812 12773 mvcc.cc:205] Tried to move back new op lower bound from 7315639448933437440 to 7315639448774451200. Current Snapshot: MvccSnapshot[applied={T|T < 7315639448933437440}]
I20260806 19:33:07.374722 12024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:07.375056 12024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:07.379819 12024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a19ef2a8e1a14139b086577b0ec1de87: Sending DeleteTablet for 3 replicas of tablet 7dedcd186bfe49db93133c6a6f8eaf75
I20260806 19:33:07.381270 12230 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:07 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:50892
I20260806 19:33:07.381904 12623 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:07 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:38088
I20260806 19:33:07.382695 12425 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dedcd186bfe49db93133c6a6f8eaf75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:07 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:56268
I20260806 19:33:07.387223 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 12121
I20260806 19:33:07.397401 12783 tablet_replica.cc:330] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: stopping tablet replica
I20260806 19:33:07.398146 12782 tablet_replica.cc:330] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: stopping tablet replica
I20260806 19:33:07.398422 12781 tablet_replica.cc:330] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: stopping tablet replica
I20260806 19:33:07.398644 12783 raft_consensus.cc:2229] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:07.398671 12782 raft_consensus.cc:2229] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:07.398957 12781 raft_consensus.cc:2229] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:33:07.399295 12782 raft_consensus.cc:2258] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:07.399302 12783 raft_consensus.cc:2258] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:07.399986 12781 raft_consensus.cc:2258] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:07.401832 12782 ts_tablet_manager.cc:1905] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:07.402935 12783 ts_tablet_manager.cc:1905] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:07.403810 12781 ts_tablet_manager.cc:1905] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 19:33:07 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:33:07.410104 12782 ts_tablet_manager.cc:1918] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:07.410338 12782 log.cc:1196] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/7dedcd186bfe49db93133c6a6f8eaf75
I20260806 19:33:07.410936 12782 ts_tablet_manager.cc:1939] T 7dedcd186bfe49db93133c6a6f8eaf75 P 864647c097d14a038fc72d7d5c0cd5aa: Deleting consensus metadata
I20260806 19:33:07.411288 12783 ts_tablet_manager.cc:1918] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:07.411556 12783 log.cc:1196] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/7dedcd186bfe49db93133c6a6f8eaf75
I20260806 19:33:07.412168 12783 ts_tablet_manager.cc:1939] T 7dedcd186bfe49db93133c6a6f8eaf75 P dbfb4658b6984c2aa1ea60349a4c0f7d: Deleting consensus metadata
I20260806 19:33:07.414352 11999 catalog_manager.cc:4841] TS 864647c097d14a038fc72d7d5c0cd5aa (127.17.18.67:41433): tablet 7dedcd186bfe49db93133c6a6f8eaf75 (table test-table [id=6041b8aada21489787fc9f59da3504a3]) successfully deleted
I20260806 19:33:07.414748 11999 catalog_manager.cc:4841] TS dbfb4658b6984c2aa1ea60349a4c0f7d (127.17.18.66:38539): tablet 7dedcd186bfe49db93133c6a6f8eaf75 (table test-table [id=6041b8aada21489787fc9f59da3504a3]) successfully deleted
I20260806 19:33:07.415680 12781 ts_tablet_manager.cc:1918] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:07.415899 12781 log.cc:1196] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/7dedcd186bfe49db93133c6a6f8eaf75
I20260806 19:33:07.416531 12781 ts_tablet_manager.cc:1939] T 7dedcd186bfe49db93133c6a6f8eaf75 P a84ed1efadc44964ae6c1567b30e5ba0: Deleting consensus metadata
I20260806 19:33:07.418639 12000 catalog_manager.cc:4841] TS a84ed1efadc44964ae6c1567b30e5ba0 (127.17.18.65:34043): tablet 7dedcd186bfe49db93133c6a6f8eaf75 (table test-table [id=6041b8aada21489787fc9f59da3504a3]) successfully deleted
I20260806 19:33:07.421504 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.391077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50904 (local address 127.17.18.65:34043)
0806 19:33:07.391286 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.391292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.393878 (+ 2586us) server_negotiation.cc:407] Connection header received
0806 19:33:07.395466 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.395474 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.395577 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.395660 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:07.399227 (+ 3567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.400428 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.402590 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.403360 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.403473 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.414353 (+ 10880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:07.414373 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:07.414394 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:07.414461 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:07.418190 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.419135 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.419143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.419145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.419309 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.419721 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.419725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.419727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.420126 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:07.420453 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.420844 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.421099 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:33:07.422242 12316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:07.526974 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 12121
I20260806 19:33:07.556586 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 12329
Aug 06 19:33:07 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:33:07.573335 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.557497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56280 (local address 127.17.18.66:38539)
0806 19:33:07.557698 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.557703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.557724 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:07.557875 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.557879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.557969 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.558057 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:07.559462 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.560290 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.562081 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.562506 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.562632 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.567006 (+ 4374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:07.567026 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:07.567047 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:07.567106 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:07.570290 (+ 3184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.571144 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.571152 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.571155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.571321 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.571774 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.571778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.571780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.572267 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:07.572518 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.572848 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.573037 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:33:07.574105 12508 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:07.667141 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 12329
I20260806 19:33:07.689754 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 12527
Aug 06 19:33:07 dist-test-slave-f0tn krb5kdc[11951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044784, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:33:07.706508 12746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:07.690590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38100 (local address 127.17.18.67:41433)
0806 19:33:07.690783 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:07.690788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:07.690809 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:07.690918 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:07.690924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:07.691008 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:07.691107 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:07.692515 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.693283 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.694800 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:07.695217 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:07.695336 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:07.700207 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:07.700228 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:07.700248 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:07.700291 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:07.703356 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.704195 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.704205 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.704214 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.704387 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:07.704820 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:07.704824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:07.704826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:07.705252 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:07.705599 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:07.705918 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 19:33:07.706165 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:33:07.707222 12711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:07.797962 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 12527
I20260806 19:33:07.826253 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 11969
I20260806 19:33:07.827548 12068 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:07.942265 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 11969
2026-08-06T19:33:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5030 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T19:33:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:08Z Disabled control of system clock
I20260806 19:33:08.054739 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:44631
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:44631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:08.440788 12796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:08.441167 12796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:08.441260 12796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:08.449261 12796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:08.449434 12796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:08.449489 12796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:08.449551 12796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:08.449610 12796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:08.459532 12796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:44631
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:44631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:08.460911 12796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:08.462982 12796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:08.475567 12811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:08.475512 12807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:08.475540 12808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:08.476667 12796 server_base.cc:1034] running on GCE node
I20260806 19:33:08.477703 12796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:08.479655 12796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:08.480932 12796 hybrid_clock.cc:648] HybridClock initialized: now 1786044788480867 us; error 63 us; skew 500 ppm
I20260806 19:33:08.481419 12796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:08.484062 12796 webserver.cc:460] Webserver started at http://127.17.18.126:46587/ using document root <none> and password file <none>
I20260806 19:33:08.484890 12796 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:08.485013 12796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:08.485409 12796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:08.488794 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "856a858eccff41ad85714b36b200bd39"
format_stamp: "Formatted at 2026-08-06 19:33:08 on dist-test-slave-f0tn"
server_key: "ff8e9ac64df5c950fb531f5c7eb56270"
server_key_iv: "9de1da48346cd7c7d4725dacefda8c41"
server_key_version: "encryptionkey@0"
I20260806 19:33:08.489790 12796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "856a858eccff41ad85714b36b200bd39"
format_stamp: "Formatted at 2026-08-06 19:33:08 on dist-test-slave-f0tn"
server_key: "ff8e9ac64df5c950fb531f5c7eb56270"
server_key_iv: "9de1da48346cd7c7d4725dacefda8c41"
server_key_version: "encryptionkey@0"
I20260806 19:33:08.495652 12796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260806 19:33:08.499701 12819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:08.501138 12796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:33:08.501361 12796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "856a858eccff41ad85714b36b200bd39"
format_stamp: "Formatted at 2026-08-06 19:33:08 on dist-test-slave-f0tn"
server_key: "ff8e9ac64df5c950fb531f5c7eb56270"
server_key_iv: "9de1da48346cd7c7d4725dacefda8c41"
server_key_version: "encryptionkey@0"
I20260806 19:33:08.501622 12796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:08.521780 12796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:08.522775 12796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:08.523075 12796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:08.541522 12796 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:44631
I20260806 19:33:08.541563 12894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:44631 every 8 connection(s)
I20260806 19:33:08.542989 12796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:08.547036 12897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:08.553239 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 12796
I20260806 19:33:08.553510 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:08.554126 17481 external_mini_cluster.cc:1428] Setting key d5a4b0ec67dfe37ad1793576549f485a
I20260806 19:33:08.559046 12897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: Bootstrap starting.
I20260806 19:33:08.562764 12897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:08.564162 12897 log.cc:824] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:08.567865 12897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: No bootstrap required, opened a new log
I20260806 19:33:08.569710 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:08.556375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58616 (local address 127.17.18.126:44631)
0806 19:33:08.557514 (+ 1139us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:08.557527 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:08.557574 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:33:08.559483 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:08.559510 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:08.560024 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:08.560379 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:08.561077 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:08.562644 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:08.564607 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:08.565514 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:08.565659 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:08.566793 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:08.566806 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:08.566825 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:08.567542 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:08.567650 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:08.567678 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:08.567796 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:08.568014 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 19:33:08.568385 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":637,"thread_start_us":383,"threads_started":1}
I20260806 19:33:08.576464 12897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } }
I20260806 19:33:08.576907 12897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:08.576988 12897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856a858eccff41ad85714b36b200bd39, State: Initialized, Role: FOLLOWER
I20260806 19:33:08.577732 12897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } }
I20260806 19:33:08.577994 12897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:08.578146 12897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:08.578341 12897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:08.580698 12897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } }
I20260806 19:33:08.581241 12897 leader_election.cc:302] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 856a858eccff41ad85714b36b200bd39; no voters:
I20260806 19:33:08.581924 12897 leader_election.cc:288] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:08.582093 12903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:08.582927 12903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [term 1 LEADER]: Becoming Leader. State: Replica: 856a858eccff41ad85714b36b200bd39, State: Running, Role: LEADER
I20260806 19:33:08.583489 12903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } }
I20260806 19:33:08.584139 12897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:08.586825 12906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 856a858eccff41ad85714b36b200bd39. Latest consensus state: current_term: 1 leader_uuid: "856a858eccff41ad85714b36b200bd39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } } }
I20260806 19:33:08.586848 12905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "856a858eccff41ad85714b36b200bd39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856a858eccff41ad85714b36b200bd39" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 44631 } } }
I20260806 19:33:08.587294 12906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:08.587301 12905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:08.590520 12915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:08.596618 12915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:08.606591 12915 catalog_manager.cc:1347] Generated new cluster ID: 2dc1a862590e4c8d957af3d7f0549247
I20260806 19:33:08.606740 12915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:08.630769 12915 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:08.632289 12915 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:08.644202 12915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: Generated new TSK 0
I20260806 19:33:08.645418 12915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:08.662309 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--builtin_ntp_servers=127.17.18.84:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:09.042874 12931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:09.043226 12931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:09.043362 12931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:09.051151 12931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:09.051335 12931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:09.051489 12931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:33:09.062426 12931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:09.064431 12931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:09.066694 12931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:09.082108 12936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:09.082033 12937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:09.082167 12939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:09.082844 12931 server_base.cc:1034] running on GCE node
I20260806 19:33:09.083621 12931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:09.084781 12931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:09.086079 12931 hybrid_clock.cc:648] HybridClock initialized: now 1786044789085982 us; error 78 us; skew 500 ppm
I20260806 19:33:09.086452 12931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:09.089433 12931 webserver.cc:460] Webserver started at http://127.17.18.65:34133/ using document root <none> and password file <none>
I20260806 19:33:09.090307 12931 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:09.090443 12931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:09.090811 12931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:09.094139 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "bd89ff4f106f4270918d9aa88a9f70fd"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "ef848ad8812d365bb30d5fe7966871cf"
server_key_iv: "8c8f06ff32e46206e7f2f9edc02363b5"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.095065 12931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "bd89ff4f106f4270918d9aa88a9f70fd"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "ef848ad8812d365bb30d5fe7966871cf"
server_key_iv: "8c8f06ff32e46206e7f2f9edc02363b5"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.101688 12931 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 19:33:09.106163 12947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.108422 12931 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:33:09.108636 12931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "bd89ff4f106f4270918d9aa88a9f70fd"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "ef848ad8812d365bb30d5fe7966871cf"
server_key_iv: "8c8f06ff32e46206e7f2f9edc02363b5"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.108872 12931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:09.138312 12931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:09.139380 12931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:09.139807 12931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:09.141116 12931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:09.143026 12931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:09.143148 12931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.143249 12931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:09.143306 12931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.179440 12931 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:41595
I20260806 19:33:09.179507 13102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:41595 every 8 connection(s)
I20260806 19:33:09.180902 12931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:33:09.189559 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 12931
I20260806 19:33:09.189739 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:33:09.190199 17481 external_mini_cluster.cc:1428] Setting key c5aea0f2ab071c71992775cdbc425be5
I20260806 19:33:09.193347 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--builtin_ntp_servers=127.17.18.84:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:09.195585 13107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:09.183819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:53537 (local address 127.17.18.126:44631)
0806 19:33:09.184365 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:09.184370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:09.185843 (+ 1473us) server_negotiation.cc:407] Connection header received
0806 19:33:09.187918 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:09.187924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:09.188020 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:09.188124 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:09.189543 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.190536 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.192303 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.192763 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.192873 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:09.194777 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:09.194783 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:09.194786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:09.194808 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:09.194853 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:09.194867 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:09.194941 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:09.195207 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 19:33:09.195309 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":274,"threads_started":1}
I20260806 19:33:09.197096 13108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:09.184507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:44631 (local address 127.17.18.65:53537)
0806 19:33:09.185637 (+ 1130us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:09.185709 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:09.187563 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:09.188417 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:09.188427 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:09.188531 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:09.189265 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:09.189297 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.190740 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.190746 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:09.192138 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:09.192155 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.193032 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.193041 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:09.193429 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:09.194303 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:09.194307 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:09.194393 (+ 86us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:09.194515 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:09.194966 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:09.194978 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:09.194986 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:33:09.195188 (+ 202us) client_negotiation.cc:240] Negotiation successful
0806 19:33:09.195657 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":307,"threads_started":1}
I20260806 19:33:09.199096 13103 heartbeater.cc:347] Connected to a master server at 127.17.18.126:44631
I20260806 19:33:09.199466 13103 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:09.200521 13103 heartbeater.cc:511] Master 127.17.18.126:44631 requested a full tablet report, sending...
I20260806 19:33:09.203236 12842 ts_manager.cc:194] Registered new tserver with Master: bd89ff4f106f4270918d9aa88a9f70fd (127.17.18.65:41595)
I20260806 19:33:09.205142 12842 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.65:53537
W20260806 19:33:09.584674 13110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:09.585052 13110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:09.585182 13110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:09.593358 13110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:09.593545 13110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:09.593693 13110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:33:09.603683 13110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:09.605203 13110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:09.607342 13110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:09.622063 13117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:09.621973 13118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:09.622000 13121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:09.623226 13110 server_base.cc:1034] running on GCE node
I20260806 19:33:09.623935 13110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:09.625105 13110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:09.626359 13110 hybrid_clock.cc:648] HybridClock initialized: now 1786044789626301 us; error 47 us; skew 500 ppm
I20260806 19:33:09.626715 13110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:09.629230 13110 webserver.cc:460] Webserver started at http://127.17.18.66:42669/ using document root <none> and password file <none>
I20260806 19:33:09.630002 13110 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:09.630112 13110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:09.630450 13110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:09.633608 13110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "01f7220778b8498c81c86cb28a174fd5"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "fad11402f1f77a2e4fd8e58806c4e272"
server_key_iv: "151c81b4cdd06215ad5c30977ad41dd8"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.634454 13110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "01f7220778b8498c81c86cb28a174fd5"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "fad11402f1f77a2e4fd8e58806c4e272"
server_key_iv: "151c81b4cdd06215ad5c30977ad41dd8"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.640055 13110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:33:09.643905 13131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.645416 13110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:33:09.645591 13110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "01f7220778b8498c81c86cb28a174fd5"
format_stamp: "Formatted at 2026-08-06 19:33:09 on dist-test-slave-f0tn"
server_key: "fad11402f1f77a2e4fd8e58806c4e272"
server_key_iv: "151c81b4cdd06215ad5c30977ad41dd8"
server_key_version: "encryptionkey@0"
I20260806 19:33:09.645805 13110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:09.662242 13110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:09.663131 13110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:09.663439 13110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:09.664466 13110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:09.666080 13110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:09.666170 13110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.666294 13110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:09.666363 13110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:09.698992 13110 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:46075
I20260806 19:33:09.699056 13308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:46075 every 8 connection(s)
I20260806 19:33:09.700379 13110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:33:09.701839 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 13110
I20260806 19:33:09.702045 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:33:09.702620 17481 external_mini_cluster.cc:1428] Setting key d0fb3e28dbdd500465f2cfa22ceec858
I20260806 19:33:09.706200 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--builtin_ntp_servers=127.17.18.84:46873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:09.716140 13312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:09.703613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:51203 (local address 127.17.18.126:44631)
0806 19:33:09.704064 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:09.704069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:09.705776 (+ 1707us) server_negotiation.cc:407] Connection header received
0806 19:33:09.708345 (+ 2569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:09.708350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:09.708428 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:09.708533 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:09.710028 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.710801 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.713009 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.713518 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.713648 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:09.715348 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:09.715354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:09.715357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:09.715381 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:09.715424 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:09.715437 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:09.715509 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:09.715776 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 19:33:09.715872 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":236,"threads_started":1}
I20260806 19:33:09.717726 13313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:09.704327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:44631 (local address 127.17.18.66:51203)
0806 19:33:09.705608 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:09.705659 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:09.707969 (+ 2310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:09.708830 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:09.708841 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:09.708966 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:09.709845 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:09.709874 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.710983 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.710988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:09.712838 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:09.712858 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:09.713762 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:09.713770 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:09.714077 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:09.714916 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:09.714919 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:09.714992 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:09.715115 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:09.715528 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:09.715540 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:09.715548 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 19:33:09.715768 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 19:33:09.716234 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":338,"threads_started":1}
I20260806 19:33:09.719334 13309 heartbeater.cc:347] Connected to a master server at 127.17.18.126:44631
I20260806 19:33:09.719717 13309 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:09.720721 13309 heartbeater.cc:511] Master 127.17.18.126:44631 requested a full tablet report, sending...
I20260806 19:33:09.722486 12842 ts_manager.cc:194] Registered new tserver with Master: 01f7220778b8498c81c86cb28a174fd5 (127.17.18.66:46075)
I20260806 19:33:09.723356 12842 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.66:51203
W20260806 19:33:10.083432 13314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:10.083761 13314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:10.083856 13314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:10.091712 13314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:10.091840 13314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:10.091955 13314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:33:10.101917 13314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:44631
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:10.103365 13314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:10.105258 13314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:10.119814 13324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:10.119757 13328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:10.119824 13323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:10.121096 13314 server_base.cc:1034] running on GCE node
I20260806 19:33:10.121876 13314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:10.122915 13314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:10.124147 13314 hybrid_clock.cc:648] HybridClock initialized: now 1786044790124086 us; error 48 us; skew 500 ppm
I20260806 19:33:10.124549 13314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:10.131207 13314 webserver.cc:460] Webserver started at http://127.17.18.67:40755/ using document root <none> and password file <none>
I20260806 19:33:10.132042 13314 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:10.132155 13314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:10.132515 13314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:10.135820 13314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "725cb09c51c24094b0a70cda21db6ada"
format_stamp: "Formatted at 2026-08-06 19:33:10 on dist-test-slave-f0tn"
server_key: "8c18ff95abbbe764c44fcc29b01ac885"
server_key_iv: "9a24c76680a5188378af1d7e30850f6a"
server_key_version: "encryptionkey@0"
I20260806 19:33:10.136720 13314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "725cb09c51c24094b0a70cda21db6ada"
format_stamp: "Formatted at 2026-08-06 19:33:10 on dist-test-slave-f0tn"
server_key: "8c18ff95abbbe764c44fcc29b01ac885"
server_key_iv: "9a24c76680a5188378af1d7e30850f6a"
server_key_version: "encryptionkey@0"
I20260806 19:33:10.142865 13314 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 19:33:10.147639 13336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:10.149876 13314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 19:33:10.150131 13314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "725cb09c51c24094b0a70cda21db6ada"
format_stamp: "Formatted at 2026-08-06 19:33:10 on dist-test-slave-f0tn"
server_key: "8c18ff95abbbe764c44fcc29b01ac885"
server_key_iv: "9a24c76680a5188378af1d7e30850f6a"
server_key_version: "encryptionkey@0"
I20260806 19:33:10.150400 13314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:10.182780 13314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:10.183907 13314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:10.184285 13314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:10.185662 13314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:10.187283 13314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:10.187381 13314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:10.187467 13314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:10.187523 13314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:10.209358 13103 heartbeater.cc:503] Master 127.17.18.126:44631 was elected leader, sending a full tablet report...
I20260806 19:33:10.221599 13314 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43405
I20260806 19:33:10.221662 13514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43405 every 8 connection(s)
I20260806 19:33:10.223012 13314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:33:10.225950 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 13314
I20260806 19:33:10.226135 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:33:10.226620 17481 external_mini_cluster.cc:1428] Setting key a632d5bf8191cd4eee65e6039a30e2af
I20260806 19:33:10.238348 13517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.226036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:42433 (local address 127.17.18.126:44631)
0806 19:33:10.227391 (+ 1355us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.227396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.228462 (+ 1066us) server_negotiation.cc:407] Connection header received
0806 19:33:10.230916 (+ 2454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.230921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.231021 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.231132 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:10.232393 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.233458 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.235160 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.235591 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.235708 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.237317 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:10.237322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:10.237326 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:10.237355 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:10.237457 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:10.237476 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:10.237563 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.237823 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.237946 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1227,"thread_start_us":1102,"threads_started":1}
I20260806 19:33:10.239472 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.226910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:44631 (local address 127.17.18.67:42433)
0806 19:33:10.228301 (+ 1391us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.228344 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.230613 (+ 2269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.231426 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.231436 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.231552 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:10.232201 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.232222 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.233638 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.233643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.234987 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.235002 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.235864 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.235874 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.236115 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.236893 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:10.236897 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:10.236958 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:10.237061 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:10.237583 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:10.237604 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:10.237611 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.237793 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.238269 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":477,"threads_started":1}
I20260806 19:33:10.241250 13515 heartbeater.cc:347] Connected to a master server at 127.17.18.126:44631
I20260806 19:33:10.241704 13515 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:10.242807 13515 heartbeater.cc:511] Master 127.17.18.126:44631 requested a full tablet report, sending...
I20260806 19:33:10.244349 12842 ts_manager.cc:194] Registered new tserver with Master: 725cb09c51c24094b0a70cda21db6ada (127.17.18.67:43405)
I20260806 19:33:10.245204 12842 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.67:42433
I20260806 19:33:10.256168 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:33:10.267132 13517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.260787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58622 (local address 127.17.18.126:44631)
0806 19:33:10.260964 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.260969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.261361 (+ 392us) server_negotiation.cc:407] Connection header received
0806 19:33:10.261528 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.261533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.261618 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.261716 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:10.262232 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.263030 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.264573 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.265061 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.265202 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.266486 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:10.266492 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:10.266495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:10.266517 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:10.266551 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:10.266564 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:10.266690 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.266824 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.266877 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 19:33:10.272168 12842 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:33:10.280092 12842 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:33:10.308856 13536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.294628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43405 (local address 127.0.0.1:33210)
0806 19:33:10.297441 (+ 2813us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.297505 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.297851 (+ 346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.299255 (+ 1404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.299261 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.299299 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:10.299832 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.299848 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.302265 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.302272 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.304995 (+ 2723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.305009 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.307418 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.307425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.307676 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.307737 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.307895 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.308386 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2458,"mutex_wait_us":109,"spinlock_wait_cycles":1920,"thread_start_us":2643,"threads_started":1}
I20260806 19:33:10.309333 13535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.294835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33210 (local address 127.17.18.67:43405)
0806 19:33:10.295590 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.295601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.297648 (+ 2047us) server_negotiation.cc:407] Connection header received
0806 19:33:10.298181 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.298191 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.298484 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.298799 (+ 315us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:10.300099 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.302004 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.305345 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.306768 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.306918 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.307265 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.308783 (+ 1518us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.309005 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":716,"threads_started":1}
I20260806 19:33:10.310017 13537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.295323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51046 (local address 127.17.18.66:46075)
0806 19:33:10.296013 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.296021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.297758 (+ 1737us) server_negotiation.cc:407] Connection header received
0806 19:33:10.298153 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.298164 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.298481 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.298689 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:10.300030 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.301884 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.306261 (+ 4377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.308044 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.308192 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.308447 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.309480 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.309672 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":462,"threads_started":1}
I20260806 19:33:10.310735 13534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.294874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:46075 (local address 127.0.0.1:51046)
0806 19:33:10.297613 (+ 2739us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.297632 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.297852 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.299161 (+ 1309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.299170 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.299208 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:10.299796 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.299815 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.302139 (+ 2324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.302146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.306027 (+ 3881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.306044 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.308602 (+ 2558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.308609 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.308909 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.309215 (+ 306us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.310258 (+ 1043us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.310420 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2616,"mutex_wait_us":1390,"spinlock_wait_cycles":27520,"thread_start_us":2013,"threads_started":1}
I20260806 19:33:10.313539 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.298082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38830)
0806 19:33:10.303470 (+ 5388us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.303490 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.303630 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.304929 (+ 1299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.304935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.304967 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:10.305472 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.305488 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.307342 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.307348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.310346 (+ 2998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.310363 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.312696 (+ 2333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.312703 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.312889 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.312924 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.313012 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.313162 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5241,"mutex_wait_us":37,"thread_start_us":5065,"threads_started":1}
I20260806 19:33:10.314419 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.298274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38830 (local address 127.17.18.65:41595)
0806 19:33:10.304172 (+ 5898us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.304182 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.304218 (+ 36us) server_negotiation.cc:407] Connection header received
0806 19:33:10.304332 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.304340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.304668 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.304976 (+ 308us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:10.305649 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.307146 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.310577 (+ 3431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.312086 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.312250 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.312547 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.313844 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.314048 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5676,"thread_start_us":5532,"threads_started":1}
I20260806 19:33:10.314229 13211 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b (DEFAULT_TABLE table=test-table [id=d2f97d54438e40309a6b605cb24b2164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:10.313989 13414 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b (DEFAULT_TABLE table=test-table [id=d2f97d54438e40309a6b605cb24b2164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:10.315553 13414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:10.315613 13211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:10.318823 13016 tablet_service.cc:1467] Processing CreateTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b (DEFAULT_TABLE table=test-table [id=d2f97d54438e40309a6b605cb24b2164]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:10.320538 13016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:10.330061 13541 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Bootstrap starting.
I20260806 19:33:10.333577 13541 tablet_bootstrap.cc:654] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:10.334232 13543 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Bootstrap starting.
I20260806 19:33:10.335733 13541 log.cc:824] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:10.337006 13545 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Bootstrap starting.
I20260806 19:33:10.339077 13543 tablet_bootstrap.cc:654] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:10.340497 13545 tablet_bootstrap.cc:654] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:10.340481 13543 log.cc:824] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:10.341414 13541 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: No bootstrap required, opened a new log
I20260806 19:33:10.341763 13541 ts_tablet_manager.cc:1397] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260806 19:33:10.341874 13545 log.cc:824] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:10.344153 13543 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: No bootstrap required, opened a new log
I20260806 19:33:10.344440 13543 ts_tablet_manager.cc:1397] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260806 19:33:10.346800 13545 tablet_bootstrap.cc:492] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: No bootstrap required, opened a new log
I20260806 19:33:10.347185 13545 ts_tablet_manager.cc:1397] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20260806 19:33:10.350631 13541 raft_consensus.cc:348] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.351092 13541 raft_consensus.cc:374] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:10.351207 13541 raft_consensus.cc:729] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725cb09c51c24094b0a70cda21db6ada, State: Initialized, Role: FOLLOWER
I20260806 19:33:10.351958 13541 consensus_queue.cc:260] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.354380 13515 heartbeater.cc:503] Master 127.17.18.126:44631 was elected leader, sending a full tablet report...
I20260806 19:33:10.355228 13541 ts_tablet_manager.cc:1428] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260806 19:33:10.355885 13543 raft_consensus.cc:348] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.356405 13543 raft_consensus.cc:374] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:10.356525 13543 raft_consensus.cc:729] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f7220778b8498c81c86cb28a174fd5, State: Initialized, Role: FOLLOWER
I20260806 19:33:10.357257 13543 consensus_queue.cc:260] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.358702 13309 heartbeater.cc:503] Master 127.17.18.126:44631 was elected leader, sending a full tablet report...
I20260806 19:33:10.358682 13545 raft_consensus.cc:348] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.359200 13545 raft_consensus.cc:374] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:10.359319 13545 raft_consensus.cc:729] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd89ff4f106f4270918d9aa88a9f70fd, State: Initialized, Role: FOLLOWER
I20260806 19:33:10.359429 13543 ts_tablet_manager.cc:1428] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260806 19:33:10.360046 13545 consensus_queue.cc:260] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.362154 13545 ts_tablet_manager.cc:1428] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
W20260806 19:33:10.433781 13104 tablet.cc:2369] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:33:10.452608 13311 tablet.cc:2369] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 19:33:10.474876 13516 tablet.cc:2369] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:33:10.516614 13551 raft_consensus.cc:482] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:33:10.517046 13551 raft_consensus.cc:504] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.519251 13551 leader_election.cc:288] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01f7220778b8498c81c86cb28a174fd5 (127.17.18.66:46075), bd89ff4f106f4270918d9aa88a9f70fd (127.17.18.65:41595)
I20260806 19:33:10.526454 13537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.519739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:42809 (local address 127.17.18.66:46075)
0806 19:33:10.520680 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.520687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.520713 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:33:10.520805 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.520812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.520903 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.521006 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:10.521573 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.522453 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.524398 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.525361 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.525549 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.525607 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.526056 (+ 449us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.526172 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772}
I20260806 19:33:10.526521 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.519532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:46075 (local address 127.17.18.67:42809)
0806 19:33:10.519748 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.519770 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.519905 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.521087 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.521094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.521127 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:10.521346 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.521360 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.522616 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.522622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.524202 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.524217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.525572 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.525580 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.525820 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.525864 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.525985 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.526155 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 19:33:10.527181 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.520148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:35627 (local address 127.17.18.65:41595)
0806 19:33:10.520334 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.520341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.520922 (+ 581us) server_negotiation.cc:407] Connection header received
0806 19:33:10.521089 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.521094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.521168 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.521245 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:10.522105 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.522932 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.524933 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.526166 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.526351 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.526429 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.526800 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.526949 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 19:33:10.527721 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.520178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.17.18.67:35627)
0806 19:33:10.520822 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.520836 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:10.520958 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:10.521422 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:10.521429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:10.521455 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:10.521881 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.521895 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.523100 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.523104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.524699 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:10.524714 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.526368 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.526374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:10.526583 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.526617 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 19:33:10.527382 (+ 765us) client_negotiation.cc:240] Negotiation successful
0806 19:33:10.527508 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":998,"threads_started":1}
I20260806 19:33:10.527848 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1b282b93a4f7aa4cc1b2449cd3d1b" candidate_uuid: "725cb09c51c24094b0a70cda21db6ada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f7220778b8498c81c86cb28a174fd5" is_pre_election: true
I20260806 19:33:10.528512 13242 raft_consensus.cc:2454] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725cb09c51c24094b0a70cda21db6ada in term 0.
I20260806 19:33:10.528620 13048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1b282b93a4f7aa4cc1b2449cd3d1b" candidate_uuid: "725cb09c51c24094b0a70cda21db6ada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" is_pre_election: true
I20260806 19:33:10.529163 13048 raft_consensus.cc:2454] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 725cb09c51c24094b0a70cda21db6ada in term 0.
I20260806 19:33:10.529343 13347 leader_election.cc:302] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01f7220778b8498c81c86cb28a174fd5, 725cb09c51c24094b0a70cda21db6ada; no voters:
I20260806 19:33:10.529865 13551 raft_consensus.cc:2781] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:33:10.530014 13551 raft_consensus.cc:482] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:33:10.530117 13551 raft_consensus.cc:3037] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:10.532661 13551 raft_consensus.cc:504] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.533346 13551 leader_election.cc:288] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [CANDIDATE]: Term 1 election: Requested vote from peers 01f7220778b8498c81c86cb28a174fd5 (127.17.18.66:46075), bd89ff4f106f4270918d9aa88a9f70fd (127.17.18.65:41595)
I20260806 19:33:10.534008 13048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1b282b93a4f7aa4cc1b2449cd3d1b" candidate_uuid: "725cb09c51c24094b0a70cda21db6ada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd89ff4f106f4270918d9aa88a9f70fd"
I20260806 19:33:10.534019 13242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecd1b282b93a4f7aa4cc1b2449cd3d1b" candidate_uuid: "725cb09c51c24094b0a70cda21db6ada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01f7220778b8498c81c86cb28a174fd5"
I20260806 19:33:10.534224 13048 raft_consensus.cc:3037] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:10.534238 13242 raft_consensus.cc:3037] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:10.536571 13048 raft_consensus.cc:2454] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725cb09c51c24094b0a70cda21db6ada in term 1.
I20260806 19:33:10.536574 13242 raft_consensus.cc:2454] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 725cb09c51c24094b0a70cda21db6ada in term 1.
I20260806 19:33:10.537111 13337 leader_election.cc:302] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 725cb09c51c24094b0a70cda21db6ada, bd89ff4f106f4270918d9aa88a9f70fd; no voters:
I20260806 19:33:10.537536 13551 raft_consensus.cc:2781] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:10.538136 13551 raft_consensus.cc:686] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 1 LEADER]: Becoming Leader. State: Replica: 725cb09c51c24094b0a70cda21db6ada, State: Running, Role: LEADER
I20260806 19:33:10.538741 13551 consensus_queue.cc:237] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } }
I20260806 19:33:10.544603 12842 catalog_manager.cc:5495] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada reported cstate change: term changed from 0 to 1, leader changed from <none> to 725cb09c51c24094b0a70cda21db6ada (127.17.18.67). New cstate: current_term: 1 leader_uuid: "725cb09c51c24094b0a70cda21db6ada" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "725cb09c51c24094b0a70cda21db6ada" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 } health_report { overall_health: UNKNOWN } } }
I20260806 19:33:10.566493 13535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.560600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33218 (local address 127.17.18.67:43405)
0806 19:33:10.560862 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.560868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.560889 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:10.560997 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.561001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.561117 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.561270 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:33:10.561749 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.562520 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.563979 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.564419 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.564540 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.565219 (+ 679us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:33:10.565840 (+ 621us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:33:10.566024 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.566217 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.566266 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 19:33:10.576324 13242 raft_consensus.cc:1261] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 1 FOLLOWER]: Refusing update from remote peer 725cb09c51c24094b0a70cda21db6ada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:10.576324 13048 raft_consensus.cc:1261] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 1 FOLLOWER]: Refusing update from remote peer 725cb09c51c24094b0a70cda21db6ada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:10.577679 13559 consensus_queue.cc:1035] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd89ff4f106f4270918d9aa88a9f70fd" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 41595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:10.578110 13551 consensus_queue.cc:1035] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [LEADER]: Connected to new peer: Peer: permanent_uuid: "01f7220778b8498c81c86cb28a174fd5" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 46075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:10.592082 13563 mvcc.cc:205] Tried to move back new op lower bound from 7315639462187073536 to 7315639462051184640. Current Snapshot: MvccSnapshot[applied={T|T < 7315639462187073536}]
I20260806 19:33:10.610292 12842 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:10.610564 12842 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:10.614888 12842 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 856a858eccff41ad85714b36b200bd39: Sending DeleteTablet for 3 replicas of tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b
I20260806 19:33:10.616413 13414 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:10 UTC) from {username='slave'} at 127.0.0.1:33210
I20260806 19:33:10.616648 13016 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:10 UTC) from {username='slave'} at 127.0.0.1:38830
I20260806 19:33:10.617331 13211 tablet_service.cc:1514] Processing DeleteTablet for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:10 UTC) from {username='slave'} at 127.0.0.1:51046
I20260806 19:33:10.620615 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 12931
I20260806 19:33:10.630092 13580 tablet_replica.cc:330] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: stopping tablet replica
I20260806 19:33:10.630700 13580 raft_consensus.cc:2229] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:10.631354 13580 raft_consensus.cc:2258] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:10.635541 13581 tablet_replica.cc:330] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: stopping tablet replica
I20260806 19:33:10.636230 13581 raft_consensus.cc:2229] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:10.636965 13579 tablet_replica.cc:330] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: stopping tablet replica
I20260806 19:33:10.637194 13580 ts_tablet_manager.cc:1905] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P bd89ff4f106f4270918d9aa88a9f70fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:10.637627 13581 raft_consensus.cc:2258] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:10.638435 13579 raft_consensus.cc:2229] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:33:10.639210 13579 raft_consensus.cc:2258] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:10.641871 13581 ts_tablet_manager.cc:1905] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:10.642966 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.622514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38840 (local address 127.17.18.65:41595)
0806 19:33:10.622726 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.622733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.634572 (+ 11839us) server_negotiation.cc:407] Connection header received
0806 19:33:10.634800 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.634806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.634955 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.635047 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:10.635779 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.636857 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.638798 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.639479 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.639596 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.641032 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:10.641047 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:10.641066 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:10.641945 (+ 879us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:10.642015 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:10.642042 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:10.642141 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.642406 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.642541 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:33:10.644186 13097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:10.644168 13579 ts_tablet_manager.cc:1905] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:10.649991 13581 ts_tablet_manager.cc:1918] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:10.650364 13581 log.cc:1196] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/ecd1b282b93a4f7aa4cc1b2449cd3d1b
I20260806 19:33:10.651029 13581 ts_tablet_manager.cc:1939] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 01f7220778b8498c81c86cb28a174fd5: Deleting consensus metadata
I20260806 19:33:10.653257 13579 ts_tablet_manager.cc:1918] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:10.653554 13579 log.cc:1196] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/ecd1b282b93a4f7aa4cc1b2449cd3d1b
I20260806 19:33:10.653645 12824 catalog_manager.cc:4841] TS 01f7220778b8498c81c86cb28a174fd5 (127.17.18.66:46075): tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b (table test-table [id=d2f97d54438e40309a6b605cb24b2164]) successfully deleted
I20260806 19:33:10.654207 13579 ts_tablet_manager.cc:1939] T ecd1b282b93a4f7aa4cc1b2449cd3d1b P 725cb09c51c24094b0a70cda21db6ada: Deleting consensus metadata
I20260806 19:33:10.655928 12820 catalog_manager.cc:4841] TS 725cb09c51c24094b0a70cda21db6ada (127.17.18.67:43405): tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b (table test-table [id=d2f97d54438e40309a6b605cb24b2164]) successfully deleted
I20260806 19:33:10.748723 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 12931
I20260806 19:33:10.785270 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 13110
W20260806 19:33:10.785318 12820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.18.65:41595 (error 108)
I20260806 19:33:10.787746 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.787270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38852)
0806 19:33:10.787437 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.787566 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 19:33:10.788046 12820 catalog_manager.cc:4584] TS bd89ff4f106f4270918d9aa88a9f70fd (127.17.18.65:41595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ecd1b282b93a4f7aa4cc1b2449cd3d1b: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
I20260806 19:33:10.793723 13537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.786283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51056 (local address 127.17.18.66:46075)
0806 19:33:10.786672 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.786678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.786698 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:33:10.786765 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.786771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.786895 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.787023 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:10.787552 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.788581 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.790555 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.791017 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.791117 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.792304 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:10.792313 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:10.792330 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:10.792942 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:10.792991 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:10.793012 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:10.793110 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.793249 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.793345 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260806 19:33:10.794615 13304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:10.842206 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.841637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38860)
0806 19:33:10.841901 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.842019 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 19:33:10.843452 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.843025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38870)
0806 19:33:10.843192 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.843291 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 19:33:10.888092 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 13110
I20260806 19:33:10.905299 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.904628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38880)
0806 19:33:10.904912 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.905071 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 19:33:10.906698 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.906233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38886)
0806 19:33:10.906409 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.906505 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 19:33:10.917188 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 13314
I20260806 19:33:10.925273 13535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.918318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.17.18.67:43405)
0806 19:33:10.918554 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:10.918561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:10.918578 (+ 17us) server_negotiation.cc:407] Connection header received
0806 19:33:10.918633 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:10.918637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:10.918718 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:10.918809 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:10.919260 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.920221 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.921897 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:10.922367 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:10.922492 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:10.923722 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:10.923733 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:10.923751 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:10.924423 (+ 672us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:10.924480 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:10.924515 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:10.924632 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:10.924792 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 19:33:10.924922 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:33:10.926230 13505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:10.987411 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.986773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38892)
0806 19:33:10.987030 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.987155 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 19:33:10.988648 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:10.988162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38898)
0806 19:33:10.988390 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:10.988497 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260806 19:33:11.053802 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 13314
I20260806 19:33:11.086184 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 12796
I20260806 19:33:11.087464 12887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:11.201535 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:11.200828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:41595 (local address 127.0.0.1:38900)
0806 19:33:11.201054 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:11.201173 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:41595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 19:33:11.201556 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 12796
2026-08-06T19:33:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3253 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:11 dist-test-slave-f0tn krb5kdc[13593](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:11 dist-test-slave-f0tn krb5kdc[13593](info): set up 2 sockets
Aug 06 19:33:11 dist-test-slave-f0tn krb5kdc[13593](info): commencing operation
krb5kdc: starting...
W20260806 19:33:12.460759 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:12 dist-test-slave-f0tn krb5kdc[13593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:12.833787 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41115
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:41115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:13.223573 13611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:13.224177 13611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:13.224345 13611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:13.232297 13611 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:13.232450 13611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:13.232508 13611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:13.232594 13611 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:13.232673 13611 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:13.243505 13611 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:41115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:13.245002 13611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:13.246510 13611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:13.259852 13620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:13.259788 13621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:13.259828 13624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:13.260819 13611 server_base.cc:1034] running on GCE node
I20260806 19:33:13.261816 13611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:13.263495 13611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:13.264780 13611 hybrid_clock.cc:648] HybridClock initialized: now 1786044793264716 us; error 54 us; skew 500 ppm
I20260806 19:33:13.265169 13611 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:13 dist-test-slave-f0tn krb5kdc[13593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044793, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:13.268760 13611 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:13.270664 13611 webserver.cc:460] Webserver started at http://127.17.18.126:39645/ using document root <none> and password file <none>
I20260806 19:33:13.271418 13611 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:13.271531 13611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:13.271813 13611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:13.275141 13611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "44e1006c436042e6a2d88c7ae02ada23"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "26d862f7ef5061cbe93ca692f4abee6c"
server_key_iv: "763ae83501f176d4ba97ff22ac846bb4"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.275925 13611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "44e1006c436042e6a2d88c7ae02ada23"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "26d862f7ef5061cbe93ca692f4abee6c"
server_key_iv: "763ae83501f176d4ba97ff22ac846bb4"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.281857 13611 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 19:33:13.285825 13635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:13.287281 13611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:33:13.287469 13611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "44e1006c436042e6a2d88c7ae02ada23"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "26d862f7ef5061cbe93ca692f4abee6c"
server_key_iv: "763ae83501f176d4ba97ff22ac846bb4"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.287665 13611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:13.307211 13611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:13.312261 13611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:13.312548 13611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:13.333230 13611 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:41115
I20260806 19:33:13.333150 13712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:41115 every 8 connection(s)
I20260806 19:33:13.334846 13611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:13.339171 13713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:13.342160 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 13611
I20260806 19:33:13.342371 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:13.342834 17481 external_mini_cluster.cc:1428] Setting key 0cf248ddc57a4be1c3168cb8de81c446
I20260806 19:33:13.354054 13713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: Bootstrap starting.
I20260806 19:33:13.358081 13713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:13.359238 13713 log.cc:824] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:33:13 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:13.362874 13713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: No bootstrap required, opened a new log
I20260806 19:33:13.369854 13716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:13.344988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51054 (local address 127.17.18.126:41115)
0806 19:33:13.345995 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:13.346013 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:13.346072 (+ 59us) server_negotiation.cc:407] Connection header received
0806 19:33:13.348566 (+ 2494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:13.348605 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:13.349208 (+ 603us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:13.349799 (+ 591us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:13.351510 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:13.353598 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:13.355216 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:13.356369 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:13.356597 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:13.361342 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:13.361351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:13.361370 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:13.361447 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:13.364897 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:13.365868 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:13.365878 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:13.365887 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:13.366128 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:13.366554 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:13.366565 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:13.366567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:13.367225 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:13.367578 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:13.368081 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 19:33:13.368607 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":421,"threads_started":1}
I20260806 19:33:13.371572 13713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } }
I20260806 19:33:13.372088 13713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:13.372228 13713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44e1006c436042e6a2d88c7ae02ada23, State: Initialized, Role: FOLLOWER
I20260806 19:33:13.372953 13713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } }
I20260806 19:33:13.373268 13713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:13.373441 13713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:13.373615 13713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:13.375967 13713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } }
I20260806 19:33:13.376524 13713 leader_election.cc:302] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44e1006c436042e6a2d88c7ae02ada23; no voters:
I20260806 19:33:13.377224 13713 leader_election.cc:288] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:13.377406 13720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:13.378561 13720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [term 1 LEADER]: Becoming Leader. State: Replica: 44e1006c436042e6a2d88c7ae02ada23, State: Running, Role: LEADER
I20260806 19:33:13.379207 13720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } }
I20260806 19:33:13.379727 13713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:13.382323 13722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44e1006c436042e6a2d88c7ae02ada23. Latest consensus state: current_term: 1 leader_uuid: "44e1006c436042e6a2d88c7ae02ada23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } } }
I20260806 19:33:13.382841 13722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:13.382768 13721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44e1006c436042e6a2d88c7ae02ada23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44e1006c436042e6a2d88c7ae02ada23" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41115 } } }
I20260806 19:33:13.383078 13721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:13.385030 13729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:13.389968 13729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:13.398926 13729 catalog_manager.cc:1347] Generated new cluster ID: fda720327e444dc7afe4d84404b2feda
I20260806 19:33:13.399073 13729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:13.426789 13729 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:13.428285 13729 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:13.437371 13729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: Generated new TSK 0
I20260806 19:33:13.438390 13729 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.18.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
Entry for principal kudu/127.17.18.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab.
I20260806 19:33:13.525252 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:13.904874 13749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:13.905202 13749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:13.905331 13749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:13.913133 13749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:13.913285 13749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:13.913475 13749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:33:13.924068 13749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.65.keytab
--principal=kudu/127.17.18.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:13.925544 13749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:13.926975 13749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:13.941105 13758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:13.941124 13759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:13.941438 13761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:13.942312 13749 server_base.cc:1034] running on GCE node
I20260806 19:33:13.943029 13749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:13.944211 13749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:13.945472 13749 hybrid_clock.cc:648] HybridClock initialized: now 1786044793945405 us; error 53 us; skew 500 ppm
I20260806 19:33:13.945897 13749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:13 dist-test-slave-f0tn krb5kdc[13593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044793, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:13.949611 13749 init.cc:377] Logged in from keytab as kudu/127.17.18.65@KRBTEST.COM (short username kudu)
I20260806 19:33:13.951427 13749 webserver.cc:460] Webserver started at http://127.17.18.65:46101/ using document root <none> and password file <none>
I20260806 19:33:13.952234 13749 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:13.952394 13749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:13.952754 13749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:13.956133 13749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "df945c15fd534b688def4d3316afbda3"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "33a52f9a8d5b8ab452a1cdb74bd27957"
server_key_iv: "f8770597946fa47bee80cfbc19cd340b"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.957041 13749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "df945c15fd534b688def4d3316afbda3"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "33a52f9a8d5b8ab452a1cdb74bd27957"
server_key_iv: "f8770597946fa47bee80cfbc19cd340b"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.963102 13749 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 19:33:13.967257 13771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:13.968880 13749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260806 19:33:13.969106 13749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "df945c15fd534b688def4d3316afbda3"
format_stamp: "Formatted at 2026-08-06 19:33:13 on dist-test-slave-f0tn"
server_key: "33a52f9a8d5b8ab452a1cdb74bd27957"
server_key_iv: "f8770597946fa47bee80cfbc19cd340b"
server_key_version: "encryptionkey@0"
I20260806 19:33:13.969353 13749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:14.009907 13749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:14.014632 13749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:14.014940 13749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:14.016019 13749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:14.017553 13749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:14.017637 13749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:14.017771 13749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:14.017833 13749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:14.052199 13749 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:40891
I20260806 19:33:14.052284 13941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:40891 every 8 connection(s)
I20260806 19:33:14.053653 13749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:33:14.063782 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 13749
I20260806 19:33:14.063979 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:33:14.064453 17481 external_mini_cluster.cc:1428] Setting key 198f05b0a771a09e788be79d61f8537d
Aug 06 19:33:14 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044793, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.65@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:14.075412 13944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:14.056373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:33963 (local address 127.17.18.126:41115)
0806 19:33:14.056844 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:14.056849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:14.057808 (+ 959us) server_negotiation.cc:407] Connection header received
0806 19:33:14.059797 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:14.059803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:14.059894 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:14.059992 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:14.061769 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.062500 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.064250 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.064716 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.064848 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:14.068671 (+ 3823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:14.068677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:14.068680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:14.068716 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:14.071432 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:14.072355 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:14.072364 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:14.072366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:14.072511 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:14.073253 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:14.073259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:14.073263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:14.073696 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:14.073855 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:14.074746 (+ 891us) server_negotiation.cc:299] Negotiation successful
0806 19:33:14.075016 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":256,"threads_started":1}
I20260806 19:33:14.076519 13946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:14.056865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41115 (local address 127.17.18.65:33963)
0806 19:33:14.057639 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:14.057683 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:14.059484 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:14.060266 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:14.060277 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:14.060876 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:14.061561 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:14.061583 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.062686 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.062690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:14.064076 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:14.064092 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.064987 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.064995 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:14.065252 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:14.065990 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:14.066015 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:14.068415 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:14.071651 (+ 3236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:14.071661 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:14.071678 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:14.072195 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:14.072702 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:14.072708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:14.072711 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:14.073070 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:14.073862 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:14.073873 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:14.074328 (+ 455us) client_negotiation.cc:769] Sending connection context
0806 19:33:14.074614 (+ 286us) client_negotiation.cc:240] Negotiation successful
0806 19:33:14.075227 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":297,"threads_started":1}
I20260806 19:33:14.078341 13942 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41115
I20260806 19:33:14.078681 13942 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:14.079497 13942 heartbeater.cc:511] Master 127.17.18.126:41115 requested a full tablet report, sending...
I20260806 19:33:14.081929 13662 ts_manager.cc:194] Registered new tserver with Master: df945c15fd534b688def4d3316afbda3 (127.17.18.65:40891)
I20260806 19:33:14.083539 13662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.65@KRBTEST.COM'} at 127.17.18.65:33963
WARNING: no policy specified for kudu/127.17.18.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
Entry for principal kudu/127.17.18.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab.
I20260806 19:33:14.142246 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:14.521366 13949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:14.521777 13949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:14.521936 13949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:14.530869 13949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:14.531024 13949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:14.531200 13949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:33:14.541921 13949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.66.keytab
--principal=kudu/127.17.18.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:14.543378 13949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:14.544813 13949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:14.558885 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:14.558966 13958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:14.559254 13960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:14.560284 13949 server_base.cc:1034] running on GCE node
I20260806 19:33:14.561149 13949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:14.562402 13949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:14.563648 13949 hybrid_clock.cc:648] HybridClock initialized: now 1786044794563571 us; error 72 us; skew 500 ppm
I20260806 19:33:14.564036 13949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:14 dist-test-slave-f0tn krb5kdc[13593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044794, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:14.567559 13949 init.cc:377] Logged in from keytab as kudu/127.17.18.66@KRBTEST.COM (short username kudu)
I20260806 19:33:14.569278 13949 webserver.cc:460] Webserver started at http://127.17.18.66:33635/ using document root <none> and password file <none>
I20260806 19:33:14.570046 13949 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:14.570183 13949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:14.570477 13949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:14.573711 13949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "82e2689d6ff540029a96de5fda25be52"
format_stamp: "Formatted at 2026-08-06 19:33:14 on dist-test-slave-f0tn"
server_key: "3725735bac262106f78db0c9386d48df"
server_key_iv: "2f2f28e0be361013a41e1a54c0402645"
server_key_version: "encryptionkey@0"
I20260806 19:33:14.574574 13949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "82e2689d6ff540029a96de5fda25be52"
format_stamp: "Formatted at 2026-08-06 19:33:14 on dist-test-slave-f0tn"
server_key: "3725735bac262106f78db0c9386d48df"
server_key_iv: "2f2f28e0be361013a41e1a54c0402645"
server_key_version: "encryptionkey@0"
I20260806 19:33:14.580693 13949 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:33:14.584985 13971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:14.586607 13949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:14.586807 13949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "82e2689d6ff540029a96de5fda25be52"
format_stamp: "Formatted at 2026-08-06 19:33:14 on dist-test-slave-f0tn"
server_key: "3725735bac262106f78db0c9386d48df"
server_key_iv: "2f2f28e0be361013a41e1a54c0402645"
server_key_version: "encryptionkey@0"
I20260806 19:33:14.587041 13949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:14.612509 13949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:14.617437 13949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:14.617762 13949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:14.618943 13949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:14.620484 13949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:14.620580 13949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:14.620692 13949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:14.620752 13949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:14.655505 13949 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:37133
I20260806 19:33:14.655553 14144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:37133 every 8 connection(s)
I20260806 19:33:14.657301 13949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:33:14.660136 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 13949
I20260806 19:33:14.660332 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:33:14.660934 17481 external_mini_cluster.cc:1428] Setting key 1d0f5971860c0b2cdda79ae3124762f5
Aug 06 19:33:14 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044794, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.66@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:14.680122 14154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:14.660380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:44365 (local address 127.17.18.126:41115)
0806 19:33:14.660902 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:14.660910 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:14.662096 (+ 1186us) server_negotiation.cc:407] Connection header received
0806 19:33:14.664131 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:14.664136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:14.664237 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:14.664368 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:14.666387 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.667177 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.668850 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.669297 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.669470 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:14.673273 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:14.673281 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:14.673286 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:14.673332 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:14.676215 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:14.677091 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:14.677098 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:14.677102 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:14.677269 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:14.677931 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:14.677937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:14.677940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:14.678386 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:14.678561 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:14.679428 (+ 867us) server_negotiation.cc:299] Negotiation successful
0806 19:33:14.679740 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":252,"threads_started":1}
I20260806 19:33:14.681118 14155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:14.660936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41115 (local address 127.17.18.66:44365)
0806 19:33:14.661914 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:14.661965 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:14.663805 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:14.664783 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:14.664793 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:14.665467 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:14.666166 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:14.666189 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.667356 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.667361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:14.668677 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:14.668692 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:14.669604 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:14.669613 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:14.669857 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:14.670559 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:14.670585 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:14.672960 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:14.676416 (+ 3456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:14.676427 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:14.676445 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:14.676949 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:14.677442 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:14.677448 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:14.677451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:14.677787 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:14.678590 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:14.678597 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:14.678993 (+ 396us) client_negotiation.cc:769] Sending connection context
0806 19:33:14.679262 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 19:33:14.679794 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":372,"threads_started":1}
I20260806 19:33:14.682813 14148 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41115
I20260806 19:33:14.683156 14148 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:14.683938 14148 heartbeater.cc:511] Master 127.17.18.126:41115 requested a full tablet report, sending...
I20260806 19:33:14.685737 13662 ts_manager.cc:194] Registered new tserver with Master: 82e2689d6ff540029a96de5fda25be52 (127.17.18.66:37133)
I20260806 19:33:14.686620 13662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.66@KRBTEST.COM'} at 127.17.18.66:44365
WARNING: no policy specified for kudu/127.17.18.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
Entry for principal kudu/127.17.18.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab.
I20260806 19:33:14.742054 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:46601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:33:15.086932 13942 heartbeater.cc:503] Master 127.17.18.126:41115 was elected leader, sending a full tablet report...
W20260806 19:33:15.112983 14158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:15.113340 14158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:15.113500 14158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:15.121244 14158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:15.121428 14158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:15.121598 14158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:33:15.132010 14158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:46601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.67.keytab
--principal=kudu/127.17.18.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:15.133764 14158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:15.135432 14158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:15.150028 14167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:15.150059 14170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:15.150095 14168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:15.150985 14158 server_base.cc:1034] running on GCE node
I20260806 19:33:15.151767 14158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:15.152915 14158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:15.154210 14158 hybrid_clock.cc:648] HybridClock initialized: now 1786044795154154 us; error 37 us; skew 500 ppm
I20260806 19:33:15.154599 14158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:15 dist-test-slave-f0tn krb5kdc[13593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044795, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:15.162323 14158 init.cc:377] Logged in from keytab as kudu/127.17.18.67@KRBTEST.COM (short username kudu)
I20260806 19:33:15.164211 14158 webserver.cc:460] Webserver started at http://127.17.18.67:40701/ using document root <none> and password file <none>
I20260806 19:33:15.165032 14158 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:15.165182 14158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:15.165599 14158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:15.168946 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "c0974e58a0ad48f8b21086b350083d93"
format_stamp: "Formatted at 2026-08-06 19:33:15 on dist-test-slave-f0tn"
server_key: "7f23db3bd4670a5c8758e60ebb26b67c"
server_key_iv: "f6bf31dc4d2d14cf9742a70435667d08"
server_key_version: "encryptionkey@0"
I20260806 19:33:15.169940 14158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "c0974e58a0ad48f8b21086b350083d93"
format_stamp: "Formatted at 2026-08-06 19:33:15 on dist-test-slave-f0tn"
server_key: "7f23db3bd4670a5c8758e60ebb26b67c"
server_key_iv: "f6bf31dc4d2d14cf9742a70435667d08"
server_key_version: "encryptionkey@0"
I20260806 19:33:15.176234 14158 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260806 19:33:15.180990 14180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:15.182900 14158 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:33:15.183099 14158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "c0974e58a0ad48f8b21086b350083d93"
format_stamp: "Formatted at 2026-08-06 19:33:15 on dist-test-slave-f0tn"
server_key: "7f23db3bd4670a5c8758e60ebb26b67c"
server_key_iv: "f6bf31dc4d2d14cf9742a70435667d08"
server_key_version: "encryptionkey@0"
I20260806 19:33:15.183354 14158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:15.211822 14158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:15.216660 14158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:15.216949 14158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:15.218119 14158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:15.219771 14158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:15.219856 14158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:15.219954 14158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:15.220000 14158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:15.256556 14158 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:45823
I20260806 19:33:15.256600 14346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:45823 every 8 connection(s)
I20260806 19:33:15.258057 14158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:33:15.260516 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 14158
I20260806 19:33:15.260720 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:33:15.261332 17481 external_mini_cluster.cc:1428] Setting key 5509f111fe4d2076ad72cc24910c9c56
Aug 06 19:33:15 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044795, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.67@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:15.281208 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.261021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:37659 (local address 127.17.18.126:41115)
0806 19:33:15.261556 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.261561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.262877 (+ 1316us) server_negotiation.cc:407] Connection header received
0806 19:33:15.265327 (+ 2450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.265333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.265456 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.265559 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:15.267270 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.268062 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.269741 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.270174 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.270292 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.274281 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:15.274287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:15.274291 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:15.274330 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:15.277810 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.278684 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.278688 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.278690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.278819 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.279294 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.279299 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.279302 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.279683 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:15.279827 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.280703 (+ 876us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.280905 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":233,"threads_started":1}
I20260806 19:33:15.282276 14353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.261806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41115 (local address 127.17.18.67:37659)
0806 19:33:15.262698 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.262757 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.265044 (+ 2287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.265855 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.265864 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.266463 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:15.267087 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.267106 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.268223 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.268227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.269582 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.269603 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.270421 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.270429 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.270671 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.271368 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:33:15.271394 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:15.273931 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:15.277977 (+ 4046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:15.277986 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:15.278003 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:15.278560 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:15.278903 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:33:15.278906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:33:15.278908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:33:15.279163 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:33:15.279828 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:15.279836 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:15.280298 (+ 462us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.280585 (+ 287us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.281051 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":334,"threads_started":1}
I20260806 19:33:15.283882 14348 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41115
I20260806 19:33:15.284232 14348 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:15.285079 14348 heartbeater.cc:511] Master 127.17.18.126:41115 requested a full tablet report, sending...
I20260806 19:33:15.286736 13662 ts_manager.cc:194] Registered new tserver with Master: c0974e58a0ad48f8b21086b350083d93 (127.17.18.67:45823)
I20260806 19:33:15.287637 13662 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.18.67@KRBTEST.COM'} at 127.17.18.67:37659
I20260806 19:33:15.290310 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:33:15.308089 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.294799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.17.18.126:41115)
0806 19:33:15.294969 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.294974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.295577 (+ 603us) server_negotiation.cc:407] Connection header received
0806 19:33:15.295760 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.295766 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.295844 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.295933 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:15.297468 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.298247 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.299597 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.300035 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.300157 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.302847 (+ 2690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:15.302852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:15.302855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:15.302894 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:15.305397 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.306186 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.306191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.306194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.306366 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.306735 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.306739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.306741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.307147 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:15.307369 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.307629 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.307840 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 19:33:15.312618 13662 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:33:15.319976 13662 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:33:15.369547 14370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.334297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40891 (local address 127.0.0.1:58130)
0806 19:33:15.361365 (+ 27068us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.361402 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.361525 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.362463 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.362467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.362495 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:15.362862 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.362871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.364627 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.364632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.366399 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.366413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.368461 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.368465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.368610 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.368646 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.368778 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.369008 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26958,"mutex_wait_us":25,"thread_start_us":25269,"threads_started":1}
I20260806 19:33:15.369767 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.333856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:45823 (local address 127.0.0.1:45048)
0806 19:33:15.360000 (+ 26144us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.360056 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.360296 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.361579 (+ 1283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.361588 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.361624 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:15.362042 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.362058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.364048 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.364053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.366990 (+ 2937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.367006 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.368877 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.368883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.369036 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.369065 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.369174 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.369314 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25853,"mutex_wait_us":156,"thread_start_us":26518,"threads_started":1}
I20260806 19:33:15.370311 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.334891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.17.18.67:45823)
0806 19:33:15.360148 (+ 25257us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.360157 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.360208 (+ 51us) server_negotiation.cc:407] Connection header received
0806 19:33:15.360663 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.360672 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.360939 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.361176 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:15.362291 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.363888 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.367211 (+ 3323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.368644 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.368795 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.369018 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.369250 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.369494 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25055,"thread_start_us":27401,"threads_started":1}
I20260806 19:33:15.370354 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.333779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53314 (local address 127.17.18.66:37133)
0806 19:33:15.361474 (+ 27695us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.361483 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.361511 (+ 28us) server_negotiation.cc:407] Connection header received
0806 19:33:15.361605 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.361612 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.361883 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.362098 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:15.362789 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.364255 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.367196 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.368669 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.368792 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.368992 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.369881 (+ 889us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.370068 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27484,"thread_start_us":27533,"threads_started":1}
I20260806 19:33:15.370571 14376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.335469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58130 (local address 127.17.18.65:40891)
0806 19:33:15.359309 (+ 23840us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.359321 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.361652 (+ 2331us) server_negotiation.cc:407] Connection header received
0806 19:33:15.361793 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.361798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.361969 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.362158 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:15.363034 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.364472 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.366570 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.368008 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.368150 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.368349 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.370103 (+ 1754us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.370247 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23574,"thread_start_us":23856,"threads_started":1}
I20260806 19:33:15.370872 14369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.334064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:37133 (local address 127.0.0.1:53314)
0806 19:33:15.360713 (+ 26649us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.360733 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.360878 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.362119 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.362124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.362150 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:15.362579 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.362596 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.364409 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.364414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.366992 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.367006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.369155 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.369162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.369349 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.369414 (+ 65us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.369511 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.369668 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26495,"mutex_wait_us":118,"thread_start_us":27038,"threads_started":1}
I20260806 19:33:15.374260 14044 tablet_service.cc:1467] Processing CreateTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 (DEFAULT_TABLE table=test-table [id=480cf1b42e35425e8adc5a1da58eab7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:15.374272 13846 tablet_service.cc:1467] Processing CreateTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 (DEFAULT_TABLE table=test-table [id=480cf1b42e35425e8adc5a1da58eab7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:15.375594 13846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0baf8da7cf7c4d139502d80517c42b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:15.375597 14044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0baf8da7cf7c4d139502d80517c42b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:15.385010 14244 tablet_service.cc:1467] Processing CreateTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 (DEFAULT_TABLE table=test-table [id=480cf1b42e35425e8adc5a1da58eab7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:15.386879 14244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0baf8da7cf7c4d139502d80517c42b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:15.392222 14379 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Bootstrap starting.
I20260806 19:33:15.392495 14378 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Bootstrap starting.
I20260806 19:33:15.395717 14378 tablet_bootstrap.cc:654] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:15.396173 14379 tablet_bootstrap.cc:654] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:15.396858 14378 log.cc:824] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:15.397469 14379 log.cc:824] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:15.400414 14379 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: No bootstrap required, opened a new log
I20260806 19:33:15.400415 14378 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: No bootstrap required, opened a new log
I20260806 19:33:15.400754 14378 ts_tablet_manager.cc:1397] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260806 19:33:15.400820 14379 ts_tablet_manager.cc:1397] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 19:33:15.403088 14382 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Bootstrap starting.
I20260806 19:33:15.407459 14382 tablet_bootstrap.cc:654] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:15.408916 14382 log.cc:824] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:15.409343 14378 raft_consensus.cc:348] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.409878 14378 raft_consensus.cc:374] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:15.410005 14378 raft_consensus.cc:729] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df945c15fd534b688def4d3316afbda3, State: Initialized, Role: FOLLOWER
I20260806 19:33:15.410763 14378 consensus_queue.cc:260] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.411554 14379 raft_consensus.cc:348] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.412034 14379 raft_consensus.cc:374] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:15.412143 14379 raft_consensus.cc:729] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e2689d6ff540029a96de5fda25be52, State: Initialized, Role: FOLLOWER
I20260806 19:33:15.412895 14378 ts_tablet_manager.cc:1428] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260806 19:33:15.412946 14379 consensus_queue.cc:260] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.414242 14148 heartbeater.cc:503] Master 127.17.18.126:41115 was elected leader, sending a full tablet report...
I20260806 19:33:15.414729 14382 tablet_bootstrap.cc:492] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: No bootstrap required, opened a new log
I20260806 19:33:15.414927 14379 ts_tablet_manager.cc:1428] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260806 19:33:15.415052 14382 ts_tablet_manager.cc:1397] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260806 19:33:15.423192 14382 raft_consensus.cc:348] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.423612 14382 raft_consensus.cc:374] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:15.423718 14382 raft_consensus.cc:729] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0974e58a0ad48f8b21086b350083d93, State: Initialized, Role: FOLLOWER
I20260806 19:33:15.424345 14382 consensus_queue.cc:260] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.425558 14348 heartbeater.cc:503] Master 127.17.18.126:41115 was elected leader, sending a full tablet report...
I20260806 19:33:15.426229 14382 ts_tablet_manager.cc:1428] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s
I20260806 19:33:15.465155 14387 raft_consensus.cc:482] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:33:15.465552 14387 raft_consensus.cc:504] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.467396 14387 leader_election.cc:288] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0974e58a0ad48f8b21086b350083d93 (127.17.18.67:45823), df945c15fd534b688def4d3316afbda3 (127.17.18.65:40891)
I20260806 19:33:15.474627 14376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.467901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:43297 (local address 127.17.18.65:40891)
0806 19:33:15.468124 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.468130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.468854 (+ 724us) server_negotiation.cc:407] Connection header received
0806 19:33:15.469124 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.469129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.469205 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.469309 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:15.470025 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.470781 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.472752 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.473679 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.473839 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.473913 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.474223 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.474362 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:33:15.474658 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.467818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:52281 (local address 127.17.18.67:45823)
0806 19:33:15.468049 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.468055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.468849 (+ 794us) server_negotiation.cc:407] Connection header received
0806 19:33:15.469041 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.469047 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.469115 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.469182 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:15.469943 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.470684 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.472772 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.473615 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.473775 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.473856 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.474286 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.474424 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:33:15.474677 14390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.467932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:40891 (local address 127.17.18.66:43297)
0806 19:33:15.468735 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.468750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.468938 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.469336 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.469339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.469362 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:15.469844 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.469857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.470921 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.470925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.472572 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.472588 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.473898 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.473904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.474052 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.474084 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.474169 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.474315 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":51,"spinlock_wait_cycles":23424,"thread_start_us":488,"threads_started":1}
I20260806 19:33:15.475349 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.467860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:45823 (local address 127.17.18.66:52281)
0806 19:33:15.468710 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:15.468734 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:15.468890 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:15.469243 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:15.469248 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:15.469275 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:15.469780 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.469792 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.470833 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.470839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.472600 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:15.472614 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.473870 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.473880 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:15.474082 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.474107 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:33:15.474857 (+ 750us) client_negotiation.cc:240] Negotiation successful
0806 19:33:15.475007 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":95,"spinlock_wait_cycles":37120,"thread_start_us":468,"threads_started":1}
I20260806 19:33:15.475960 13873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0baf8da7cf7c4d139502d80517c42b41" candidate_uuid: "82e2689d6ff540029a96de5fda25be52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df945c15fd534b688def4d3316afbda3" is_pre_election: true
I20260806 19:33:15.476392 14279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0baf8da7cf7c4d139502d80517c42b41" candidate_uuid: "82e2689d6ff540029a96de5fda25be52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0974e58a0ad48f8b21086b350083d93" is_pre_election: true
I20260806 19:33:15.476660 13873 raft_consensus.cc:2454] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e2689d6ff540029a96de5fda25be52 in term 0.
I20260806 19:33:15.476948 14279 raft_consensus.cc:2454] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e2689d6ff540029a96de5fda25be52 in term 0.
I20260806 19:33:15.477603 13979 leader_election.cc:302] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82e2689d6ff540029a96de5fda25be52, c0974e58a0ad48f8b21086b350083d93, df945c15fd534b688def4d3316afbda3; no voters:
I20260806 19:33:15.478056 14387 raft_consensus.cc:2781] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:33:15.478217 14387 raft_consensus.cc:482] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:33:15.478323 14387 raft_consensus.cc:3037] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:15.480786 14387 raft_consensus.cc:504] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.481586 14387 leader_election.cc:288] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [CANDIDATE]: Term 1 election: Requested vote from peers c0974e58a0ad48f8b21086b350083d93 (127.17.18.67:45823), df945c15fd534b688def4d3316afbda3 (127.17.18.65:40891)
I20260806 19:33:15.482115 14279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0baf8da7cf7c4d139502d80517c42b41" candidate_uuid: "82e2689d6ff540029a96de5fda25be52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0974e58a0ad48f8b21086b350083d93"
I20260806 19:33:15.482214 13873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0baf8da7cf7c4d139502d80517c42b41" candidate_uuid: "82e2689d6ff540029a96de5fda25be52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df945c15fd534b688def4d3316afbda3"
I20260806 19:33:15.482385 14279 raft_consensus.cc:3037] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:15.482441 13873 raft_consensus.cc:3037] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:15.485911 14279 raft_consensus.cc:2454] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e2689d6ff540029a96de5fda25be52 in term 1.
I20260806 19:33:15.485911 13873 raft_consensus.cc:2454] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e2689d6ff540029a96de5fda25be52 in term 1.
I20260806 19:33:15.486467 13979 leader_election.cc:302] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82e2689d6ff540029a96de5fda25be52, c0974e58a0ad48f8b21086b350083d93; no voters:
I20260806 19:33:15.486846 14387 raft_consensus.cc:2781] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:15.487557 14387 raft_consensus.cc:686] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 1 LEADER]: Becoming Leader. State: Replica: 82e2689d6ff540029a96de5fda25be52, State: Running, Role: LEADER
I20260806 19:33:15.488140 14387 consensus_queue.cc:237] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } }
I20260806 19:33:15.493459 13661 catalog_manager.cc:5495] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82e2689d6ff540029a96de5fda25be52 (127.17.18.66). New cstate: current_term: 1 leader_uuid: "82e2689d6ff540029a96de5fda25be52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e2689d6ff540029a96de5fda25be52" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 } health_report { overall_health: UNKNOWN } } }
W20260806 19:33:15.509928 14349 tablet.cc:2369] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:33:15.529574 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.523933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53316 (local address 127.17.18.66:37133)
0806 19:33:15.524140 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.524145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.524165 (+ 20us) server_negotiation.cc:407] Connection header received
0806 19:33:15.524275 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.524279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.524374 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.524518 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:33:15.524901 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.525778 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.527249 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.527696 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.527801 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.528367 (+ 566us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:33:15.528941 (+ 574us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:33:15.529103 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.529144 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.529224 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 19:33:15.539691 13873 raft_consensus.cc:1261] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 1 FOLLOWER]: Refusing update from remote peer 82e2689d6ff540029a96de5fda25be52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:15.539688 14279 raft_consensus.cc:1261] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 1 FOLLOWER]: Refusing update from remote peer 82e2689d6ff540029a96de5fda25be52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:15.540767 14387 consensus_queue.cc:1035] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df945c15fd534b688def4d3316afbda3" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:15.541172 14391 consensus_queue.cc:1035] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0974e58a0ad48f8b21086b350083d93" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:15.573410 13662 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:15.573782 13662 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:15.577813 13662 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44e1006c436042e6a2d88c7ae02ada23: Sending DeleteTablet for 3 replicas of tablet 0baf8da7cf7c4d139502d80517c42b41
I20260806 19:33:15.579144 14244 tablet_service.cc:1514] Processing DeleteTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:15 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:45048
I20260806 19:33:15.579136 13846 tablet_service.cc:1514] Processing DeleteTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:15 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:58130
I20260806 19:33:15.580349 14044 tablet_service.cc:1514] Processing DeleteTablet for tablet 0baf8da7cf7c4d139502d80517c42b41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:15 UTC) from {username='kudu', principal='kudu/127.17.18.126@KRBTEST.COM'} at 127.0.0.1:53314
I20260806 19:33:15.581745 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 13749
I20260806 19:33:15.597431 14413 tablet_replica.cc:330] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: stopping tablet replica
I20260806 19:33:15.598295 14413 raft_consensus.cc:2229] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:15.598755 14418 tablet_replica.cc:330] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: stopping tablet replica
I20260806 19:33:15.598984 14413 raft_consensus.cc:2258] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:15.599258 14418 raft_consensus.cc:2229] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:33:15.599891 14417 tablet_replica.cc:330] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: stopping tablet replica
I20260806 19:33:15.600345 14417 raft_consensus.cc:2229] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:15.600630 14418 raft_consensus.cc:2258] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:15.600922 14417 raft_consensus.cc:2258] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:15.603693 14413 ts_tablet_manager.cc:1905] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:15.603765 14418 ts_tablet_manager.cc:1905] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 19:33:15 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.65@KRBTEST.COM
I20260806 19:33:15.611681 14417 ts_tablet_manager.cc:1905] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:15.612828 14413 ts_tablet_manager.cc:1918] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:15.613125 14413 log.cc:1196] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-0/wal/wals/0baf8da7cf7c4d139502d80517c42b41
I20260806 19:33:15.613807 14413 ts_tablet_manager.cc:1939] T 0baf8da7cf7c4d139502d80517c42b41 P df945c15fd534b688def4d3316afbda3: Deleting consensus metadata
I20260806 19:33:15.616129 13639 catalog_manager.cc:4841] TS df945c15fd534b688def4d3316afbda3 (127.17.18.65:40891): tablet 0baf8da7cf7c4d139502d80517c42b41 (table test-table [id=480cf1b42e35425e8adc5a1da58eab7a]) successfully deleted
I20260806 19:33:15.616953 14376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.583609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58138 (local address 127.17.18.65:40891)
0806 19:33:15.583837 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.583844 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.588097 (+ 4253us) server_negotiation.cc:407] Connection header received
0806 19:33:15.588972 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.588980 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.589111 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.589195 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:15.593443 (+ 4248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.594824 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.599812 (+ 4988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.600514 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.600704 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.606769 (+ 6065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:15.606791 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:15.606815 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:15.606871 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:15.612647 (+ 5776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.613871 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.613883 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.613887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.614091 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.614654 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.614660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.614663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.615211 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:15.615562 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.616249 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.616529 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:33:15.618713 13934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:15.623176 14418 ts_tablet_manager.cc:1918] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:15.623407 14418 log.cc:1196] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/0baf8da7cf7c4d139502d80517c42b41
I20260806 19:33:15.623942 14418 ts_tablet_manager.cc:1939] T 0baf8da7cf7c4d139502d80517c42b41 P 82e2689d6ff540029a96de5fda25be52: Deleting consensus metadata
I20260806 19:33:15.625890 13640 catalog_manager.cc:4841] TS 82e2689d6ff540029a96de5fda25be52 (127.17.18.66:37133): tablet 0baf8da7cf7c4d139502d80517c42b41 (table test-table [id=480cf1b42e35425e8adc5a1da58eab7a]) successfully deleted
I20260806 19:33:15.627251 14417 ts_tablet_manager.cc:1918] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:15.627442 14417 log.cc:1196] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/0baf8da7cf7c4d139502d80517c42b41
I20260806 19:33:15.627946 14417 ts_tablet_manager.cc:1939] T 0baf8da7cf7c4d139502d80517c42b41 P c0974e58a0ad48f8b21086b350083d93: Deleting consensus metadata
I20260806 19:33:15.629779 13641 catalog_manager.cc:4841] TS c0974e58a0ad48f8b21086b350083d93 (127.17.18.67:45823): tablet 0baf8da7cf7c4d139502d80517c42b41 (table test-table [id=480cf1b42e35425e8adc5a1da58eab7a]) successfully deleted
I20260806 19:33:15.758301 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 13749
I20260806 19:33:15.783550 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 13949
Aug 06 19:33:15 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.66@KRBTEST.COM
I20260806 19:33:15.803109 14368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.784488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.17.18.66:37133)
0806 19:33:15.784703 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.784708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.784749 (+ 41us) server_negotiation.cc:407] Connection header received
0806 19:33:15.784892 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.784897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.784964 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.785086 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:15.786940 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.788137 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.790279 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.790808 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.790922 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.796380 (+ 5458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:15.796404 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:15.796424 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:15.796483 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:15.799679 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.800548 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.800557 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.800560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.800739 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.801152 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.801156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.801158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.801742 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:15.802147 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.802483 (+ 336us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.802733 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 19:33:15.803936 14140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:15.926112 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 13949
I20260806 19:33:15.956415 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 14158
Aug 06 19:33:15 dist-test-slave-f0tn krb5kdc[13593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.67@KRBTEST.COM
I20260806 19:33:15.975134 14375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:15.957347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.17.18.67:45823)
0806 19:33:15.957571 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:15.957576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:15.957597 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:15.957835 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:15.957840 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:15.957915 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:15.958023 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:15.959471 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.960277 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.961925 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:15.962360 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:15.962466 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:15.967568 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:15.967599 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:15.967632 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:15.967702 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:15.971746 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.972715 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.972726 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.972729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.972906 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:15.973363 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:15.973367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:15.973369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:15.973885 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:15.974136 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:15.974627 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 19:33:15.974841 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 19:33:15.975883 14342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:16.068499 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 14158
I20260806 19:33:16.091168 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 13611
I20260806 19:33:16.092430 13705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:16.206727 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 13611
2026-08-06T19:33:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5012 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T19:33:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:16Z Disabled control of system clock
I20260806 19:33:16.322556 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41063
--webserver_interface=127.17.18.126
--webserver_port=0
--builtin_ntp_servers=127.17.18.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:41063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:16.710062 14429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:16.710436 14429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:16.710537 14429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:16.718281 14429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:16.718417 14429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:16.718457 14429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:16.718518 14429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:16.718564 14429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:16.729652 14429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:41063
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:41063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:16.731089 14429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:16.733031 14429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:16.746718 14437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:16.746752 14441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:16.746647 14439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:16.747813 14429 server_base.cc:1034] running on GCE node
I20260806 19:33:16.748796 14429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:16.750504 14429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:16.751757 14429 hybrid_clock.cc:648] HybridClock initialized: now 1786044796751702 us; error 43 us; skew 500 ppm
I20260806 19:33:16.752187 14429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:16.754952 14429 webserver.cc:460] Webserver started at http://127.17.18.126:33959/ using document root <none> and password file <none>
I20260806 19:33:16.755806 14429 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:16.755914 14429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:16.756278 14429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:16.759842 14429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "77f2d6e0728b48c895337f017e4b78d9"
format_stamp: "Formatted at 2026-08-06 19:33:16 on dist-test-slave-f0tn"
server_key: "e7be1dcea3154bf78f1509f41687b354"
server_key_iv: "9bef465f48c08566133298963496b7d2"
server_key_version: "encryptionkey@0"
I20260806 19:33:16.760891 14429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "77f2d6e0728b48c895337f017e4b78d9"
format_stamp: "Formatted at 2026-08-06 19:33:16 on dist-test-slave-f0tn"
server_key: "e7be1dcea3154bf78f1509f41687b354"
server_key_iv: "9bef465f48c08566133298963496b7d2"
server_key_version: "encryptionkey@0"
I20260806 19:33:16.767771 14429 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 19:33:16.772107 14451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:16.773752 14429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:16.773960 14429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "77f2d6e0728b48c895337f017e4b78d9"
format_stamp: "Formatted at 2026-08-06 19:33:16 on dist-test-slave-f0tn"
server_key: "e7be1dcea3154bf78f1509f41687b354"
server_key_iv: "9bef465f48c08566133298963496b7d2"
server_key_version: "encryptionkey@0"
I20260806 19:33:16.774227 14429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:16.787564 14429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:16.788522 14429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:16.788818 14429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:16.809090 14429 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:41063
I20260806 19:33:16.809099 14527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:41063 every 8 connection(s)
I20260806 19:33:16.810604 14429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:16.814913 14529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:16.820461 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 14429
I20260806 19:33:16.820672 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:16.821264 17481 external_mini_cluster.cc:1428] Setting key cd9437e4893f61dda53f23de3cad997e
I20260806 19:33:16.827064 14529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: Bootstrap starting.
I20260806 19:33:16.831122 14529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:16.832585 14529 log.cc:824] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:16.835904 14529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: No bootstrap required, opened a new log
I20260806 19:33:16.837141 14533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:16.823553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.17.18.126:41063)
0806 19:33:16.824844 (+ 1291us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:16.824857 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:16.824917 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:33:16.826932 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:16.826963 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:16.827609 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:16.828015 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:16.828805 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:16.830333 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:16.832311 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:16.833131 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:16.833360 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:16.834608 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:16.834616 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:16.834634 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:16.835225 (+ 591us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:16.835318 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:16.835346 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:16.835456 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:16.835701 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 19:33:16.836068 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":488,"threads_started":1}
I20260806 19:33:16.845363 14529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } }
I20260806 19:33:16.846021 14529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:16.846186 14529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f2d6e0728b48c895337f017e4b78d9, State: Initialized, Role: FOLLOWER
I20260806 19:33:16.846890 14529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } }
I20260806 19:33:16.847165 14529 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:16.847307 14529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:16.847470 14529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:16.850477 14529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } }
I20260806 19:33:16.851150 14529 leader_election.cc:302] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77f2d6e0728b48c895337f017e4b78d9; no voters:
I20260806 19:33:16.851779 14529 leader_election.cc:288] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:16.851940 14535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:16.852638 14535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [term 1 LEADER]: Becoming Leader. State: Replica: 77f2d6e0728b48c895337f017e4b78d9, State: Running, Role: LEADER
I20260806 19:33:16.853204 14535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } }
I20260806 19:33:16.854060 14529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:16.856283 14539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77f2d6e0728b48c895337f017e4b78d9. Latest consensus state: current_term: 1 leader_uuid: "77f2d6e0728b48c895337f017e4b78d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } } }
I20260806 19:33:16.856885 14539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:16.856313 14537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77f2d6e0728b48c895337f017e4b78d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77f2d6e0728b48c895337f017e4b78d9" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 41063 } } }
I20260806 19:33:16.857184 14537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:16.861891 14546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:16.868083 14546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:16.878208 14546 catalog_manager.cc:1347] Generated new cluster ID: 62e79a7344fb4fe8baee526b31c5003a
I20260806 19:33:16.878348 14546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:16.915337 14546 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:16.916850 14546 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:16.936843 14546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: Generated new TSK 0
I20260806 19:33:16.937906 14546 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:16.951572 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.65:0
--local_ip_for_outbound_sockets=127.17.18.65
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--builtin_ntp_servers=127.17.18.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 19:33:17.360388 14567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:17.360736 14567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:17.360858 14567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:17.368942 14567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:17.369098 14567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:17.369246 14567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.65
I20260806 19:33:17.379267 14567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.18.65
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.65
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:17.380697 14567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:17.382700 14567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:17.396417 14575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:17.396315 14577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:17.396698 14581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:17.397713 14567 server_base.cc:1034] running on GCE node
I20260806 19:33:17.398440 14567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:17.399490 14567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:17.400753 14567 hybrid_clock.cc:648] HybridClock initialized: now 1786044797400682 us; error 60 us; skew 500 ppm
I20260806 19:33:17.401136 14567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:17.403697 14567 webserver.cc:460] Webserver started at http://127.17.18.65:38745/ using document root <none> and password file <none>
I20260806 19:33:17.404490 14567 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:17.404608 14567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:17.404928 14567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:17.408087 14567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data/instance:
uuid: "3ef912f5492a4962b0a65fe07b036c7f"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "5dae412848f2da49e7af0b7fae7f5ecf"
server_key_iv: "e5724d8b06e0e49e20d33de91756b2c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.408943 14567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance:
uuid: "3ef912f5492a4962b0a65fe07b036c7f"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "5dae412848f2da49e7af0b7fae7f5ecf"
server_key_iv: "e5724d8b06e0e49e20d33de91756b2c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.414726 14567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 19:33:17.418707 14587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.420329 14567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:17.420543 14567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal
uuid: "3ef912f5492a4962b0a65fe07b036c7f"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "5dae412848f2da49e7af0b7fae7f5ecf"
server_key_iv: "e5724d8b06e0e49e20d33de91756b2c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.420799 14567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:17.445963 14567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:17.446892 14567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:17.447237 14567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:17.448310 14567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:17.450009 14567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:17.450114 14567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.450234 14567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:17.450313 14567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.483661 14567 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.65:33453
I20260806 19:33:17.483717 14748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.65:33453 every 8 connection(s)
I20260806 19:33:17.485126 14567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/data/info.pb
I20260806 19:33:17.486620 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 14567
I20260806 19:33:17.486805 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-0/wal/instance
I20260806 19:33:17.487402 17481 external_mini_cluster.cc:1428] Setting key 77846b0262d8f063cd852155845574e5
I20260806 19:33:17.490554 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.66:0
--local_ip_for_outbound_sockets=127.17.18.66
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--builtin_ntp_servers=127.17.18.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:17.499782 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:17.488198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.65:47375 (local address 127.17.18.126:41063)
0806 19:33:17.488705 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:17.488711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:17.490304 (+ 1593us) server_negotiation.cc:407] Connection header received
0806 19:33:17.492312 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:17.492318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:17.492413 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:17.492536 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:17.493898 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.494850 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.496574 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.497128 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.497264 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:17.498848 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:17.498855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:17.498859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:17.498885 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:17.498937 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:17.498952 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:17.499048 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:17.499308 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 19:33:17.499419 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":217,"threads_started":1}
I20260806 19:33:17.500840 14754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:17.488951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41063 (local address 127.17.18.65:47375)
0806 19:33:17.490111 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:17.490165 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:17.491969 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:17.492852 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:17.492863 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:17.492976 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:17.493690 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:17.493713 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.495075 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.495079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:17.496410 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:17.496425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.497457 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.497464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:17.497716 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:17.498467 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:17.498470 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:17.498516 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:17.498613 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:17.499068 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:17.499079 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:17.499086 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:33:17.499253 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 19:33:17.499618 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":373,"threads_started":1}
I20260806 19:33:17.502758 14750 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41063
I20260806 19:33:17.503158 14750 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:17.504187 14750 heartbeater.cc:511] Master 127.17.18.126:41063 requested a full tablet report, sending...
I20260806 19:33:17.506664 14475 ts_manager.cc:194] Registered new tserver with Master: 3ef912f5492a4962b0a65fe07b036c7f (127.17.18.65:33453)
I20260806 19:33:17.508235 14475 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.65:47375
W20260806 19:33:17.862823 14756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:17.863221 14756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:17.863334 14756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:17.871249 14756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:17.871382 14756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:17.871497 14756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.66
I20260806 19:33:17.881771 14756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.18.66
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.66
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:17.883445 14756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:17.885442 14756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:17.899842 14764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:17.899772 14769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:17.899803 14765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:17.900839 14756 server_base.cc:1034] running on GCE node
I20260806 19:33:17.901585 14756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:17.902638 14756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:17.903862 14756 hybrid_clock.cc:648] HybridClock initialized: now 1786044797903800 us; error 60 us; skew 500 ppm
I20260806 19:33:17.904217 14756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:17.906891 14756 webserver.cc:460] Webserver started at http://127.17.18.66:43061/ using document root <none> and password file <none>
I20260806 19:33:17.907635 14756 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:17.907756 14756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:17.908078 14756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:17.911273 14756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data/instance:
uuid: "c3358566ecbd4fcfb46de4cea96edc0e"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "a592d668ef71b1d024ea9b81b8f701c9"
server_key_iv: "e989e2f38282ae45dd19506d8573184a"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.912130 14756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance:
uuid: "c3358566ecbd4fcfb46de4cea96edc0e"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "a592d668ef71b1d024ea9b81b8f701c9"
server_key_iv: "e989e2f38282ae45dd19506d8573184a"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.917733 14756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260806 19:33:17.921893 14775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.923471 14756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 19:33:17.923664 14756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal
uuid: "c3358566ecbd4fcfb46de4cea96edc0e"
format_stamp: "Formatted at 2026-08-06 19:33:17 on dist-test-slave-f0tn"
server_key: "a592d668ef71b1d024ea9b81b8f701c9"
server_key_iv: "e989e2f38282ae45dd19506d8573184a"
server_key_version: "encryptionkey@0"
I20260806 19:33:17.923906 14756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:17.945055 14756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:17.946067 14756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:17.946399 14756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:17.947557 14756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:17.949218 14756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:17.949324 14756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.949469 14756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:17.949543 14756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:17.984208 14756 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.66:33861
I20260806 19:33:17.984229 14943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.66:33861 every 8 connection(s)
I20260806 19:33:17.985688 14756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/data/info.pb
I20260806 19:33:17.988426 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 14756
I20260806 19:33:17.988643 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal/instance
I20260806 19:33:17.989220 17481 external_mini_cluster.cc:1428] Setting key 8fb8fc42c55b9bfa0ec0b1ab92dd2be3
I20260806 19:33:17.992367 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.18.67:0
--local_ip_for_outbound_sockets=127.17.18.67
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--builtin_ntp_servers=127.17.18.84:33043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 19:33:18.000871 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:17.988831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35119 (local address 127.17.18.126:41063)
0806 19:33:17.989013 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:17.989018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:17.991096 (+ 2078us) server_negotiation.cc:407] Connection header received
0806 19:33:17.993256 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:17.993263 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:17.993361 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:17.993496 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:17.994988 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.995765 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.997505 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.997949 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.998079 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:17.999673 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:17.999679 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:17.999682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:17.999712 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:17.999748 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:17.999762 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:17.999843 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.000108 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.000398 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:33:18.002156 14952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:17.989656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41063 (local address 127.17.18.66:35119)
0806 19:33:17.990910 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:17.990960 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:17.992902 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:17.993774 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:17.993784 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:17.993892 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:17.994752 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:17.994776 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.995948 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.995952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:17.997308 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:17.997324 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:17.998220 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:17.998229 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:17.998487 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:17.999260 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:17.999263 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:17.999314 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:17.999421 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:17.999863 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:17.999878 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:17.999885 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.000073 (+ 188us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.000813 (+ 740us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":381,"threads_started":1}
I20260806 19:33:18.004323 14949 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41063
I20260806 19:33:18.004719 14949 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:18.005803 14949 heartbeater.cc:511] Master 127.17.18.126:41063 requested a full tablet report, sending...
I20260806 19:33:18.007889 14475 ts_manager.cc:194] Registered new tserver with Master: c3358566ecbd4fcfb46de4cea96edc0e (127.17.18.66:33861)
I20260806 19:33:18.008821 14475 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.66:35119
W20260806 19:33:18.370981 14953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:18.371307 14953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:18.371438 14953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:18.379432 14953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:18.379591 14953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:18.379760 14953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.18.67
I20260806 19:33:18.389528 14953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:33043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.18.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.18.67
--webserver_port=0
--tserver_master_addrs=127.17.18.126:41063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.18.67
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:18.390934 14953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:18.392882 14953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:18.407279 14963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:18.407368 14966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:18.407311 14961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:18.408942 14953 server_base.cc:1034] running on GCE node
I20260806 19:33:18.409767 14953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:18.410836 14953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:18.412052 14953 hybrid_clock.cc:648] HybridClock initialized: now 1786044798411996 us; error 50 us; skew 500 ppm
I20260806 19:33:18.412405 14953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 19:33:18.414934 14953 webserver.cc:460] Webserver started at http://127.17.18.67:35165/ using document root <none> and password file <none>
I20260806 19:33:18.415683 14953 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:18.415796 14953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:18.416133 14953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:18.419274 14953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data/instance:
uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c"
format_stamp: "Formatted at 2026-08-06 19:33:18 on dist-test-slave-f0tn"
server_key: "05153c799bbc241f7f9dbcb21dd7aff8"
server_key_iv: "b2675fc8dcf47de4c56baada511e09ca"
server_key_version: "encryptionkey@0"
I20260806 19:33:18.420117 14953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance:
uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c"
format_stamp: "Formatted at 2026-08-06 19:33:18 on dist-test-slave-f0tn"
server_key: "05153c799bbc241f7f9dbcb21dd7aff8"
server_key_iv: "b2675fc8dcf47de4c56baada511e09ca"
server_key_version: "encryptionkey@0"
I20260806 19:33:18.425908 14953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260806 19:33:18.429814 14973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:18.431329 14953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:18.431490 14953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal
uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c"
format_stamp: "Formatted at 2026-08-06 19:33:18 on dist-test-slave-f0tn"
server_key: "05153c799bbc241f7f9dbcb21dd7aff8"
server_key_iv: "b2675fc8dcf47de4c56baada511e09ca"
server_key_version: "encryptionkey@0"
I20260806 19:33:18.431728 14953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:18.445606 14953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:18.446559 14953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:18.446887 14953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:18.447968 14953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 19:33:18.449640 14953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 19:33:18.449745 14953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:18.449867 14953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 19:33:18.449934 14953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:18.483475 14953 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.67:43047
I20260806 19:33:18.483556 15137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.67:43047 every 8 connection(s)
I20260806 19:33:18.484855 14953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/data/info.pb
I20260806 19:33:18.492558 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 14953
I20260806 19:33:18.492779 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal/instance
I20260806 19:33:18.493361 17481 external_mini_cluster.cc:1428] Setting key 2f3f1653b1960e3555b7969837fd85d2
I20260806 19:33:18.498697 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.487626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.67:52745 (local address 127.17.18.126:41063)
0806 19:33:18.487833 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.487840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.489399 (+ 1559us) server_negotiation.cc:407] Connection header received
0806 19:33:18.491289 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.491295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.491378 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.491488 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:18.492702 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.493825 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.495783 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.496397 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.496511 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.497977 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:18.497982 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:18.497985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:18.498005 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:18.498039 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:18.498051 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:18.498126 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.498317 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.498404 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:33:18.499845 15140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.488224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:41063 (local address 127.17.18.67:52745)
0806 19:33:18.489229 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.489266 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.490959 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.491722 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.491731 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.491824 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:33:18.492478 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.492496 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.494046 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.494051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.495628 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.495644 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.496621 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.496626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.496896 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.497613 (+ 717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 19:33:18.497616 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:33:18.497664 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 19:33:18.497771 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:33:18.498129 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:33:18.498135 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:33:18.498141 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.498305 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.498651 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":339,"threads_started":1}
I20260806 19:33:18.501492 15138 heartbeater.cc:347] Connected to a master server at 127.17.18.126:41063
I20260806 19:33:18.501848 15138 heartbeater.cc:464] Registering TS with master...
I20260806 19:33:18.502702 15138 heartbeater.cc:511] Master 127.17.18.126:41063 requested a full tablet report, sending...
I20260806 19:33:18.504400 14475 ts_manager.cc:194] Registered new tserver with Master: 1f28ffc8e6f94789ad7416a43fdc7d8c (127.17.18.67:43047)
I20260806 19:33:18.505223 14475 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.18.67:52745
I20260806 19:33:18.508976 17481 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 19:33:18.511785 14750 heartbeater.cc:503] Master 127.17.18.126:41063 was elected leader, sending a full tablet report...
I20260806 19:33:18.522630 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.515009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38904 (local address 127.17.18.126:41063)
0806 19:33:18.515225 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.515233 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.515727 (+ 494us) server_negotiation.cc:407] Connection header received
0806 19:33:18.515881 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.515887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.515975 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.516083 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:18.516758 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.517860 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.519918 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.520625 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.520749 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.521984 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:18.521989 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:18.521993 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:18.522016 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:18.522053 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:18.522066 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:18.522146 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.522233 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.522324 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:33:18.526939 14475 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38904:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 19:33:18.534441 14475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 19:33:18.562338 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.548815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.66:33861 (local address 127.0.0.1:58102)
0806 19:33:18.549816 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.549861 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.550037 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.552282 (+ 2245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.552292 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.552332 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:18.552781 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.552796 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.555006 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.555014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.557853 (+ 2839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.557881 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.560928 (+ 3047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.560948 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.561282 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.561358 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.561586 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.561884 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":2419,"threads_started":1}
I20260806 19:33:18.563349 15154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.549024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58102 (local address 127.17.18.66:33861)
0806 19:33:18.551189 (+ 2165us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.551211 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.551248 (+ 37us) server_negotiation.cc:407] Connection header received
0806 19:33:18.551377 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.551386 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.551702 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.551931 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:18.553049 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.554782 (+ 1733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.558218 (+ 3436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.560049 (+ 1831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.560247 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.560590 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.562669 (+ 2079us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.562930 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1978,"thread_start_us":1845,"threads_started":1}
I20260806 19:33:18.567718 14843 tablet_service.cc:1467] Processing CreateTablet for tablet 79920da9a49743e3b2e367431c0e73db (DEFAULT_TABLE table=test-table [id=66b5ef776e4449ee8ee3bd60e67e7441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:18.569473 14843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79920da9a49743e3b2e367431c0e73db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:18.571874 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.550944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43047 (local address 127.0.0.1:38002)
0806 19:33:18.563240 (+ 12296us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.563259 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.563380 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.564451 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.564456 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.564482 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:18.564820 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.564838 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.567280 (+ 2442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.567286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.568931 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.568947 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.570863 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.570870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.571088 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.571190 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.571297 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.571457 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12164,"mutex_wait_us":100,"thread_start_us":13971,"threads_started":1}
I20260806 19:33:18.571931 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.551655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38002 (local address 127.17.18.67:43047)
0806 19:33:18.554265 (+ 2610us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.554277 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.563547 (+ 9270us) server_negotiation.cc:407] Connection header received
0806 19:33:18.563656 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.563662 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.563914 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.564123 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:18.565024 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.566771 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.569120 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.570642 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.570801 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.571117 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.571360 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.571543 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2370,"thread_start_us":2156,"threads_started":1}
I20260806 19:33:18.571931 15150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.549007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45788)
0806 19:33:18.551561 (+ 2554us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.551586 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.551736 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.564151 (+ 12415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.564157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.564191 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:18.564662 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.564676 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.566938 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.566944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.569114 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.569131 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.571094 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.571102 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.571295 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.571331 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.571398 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.571546 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2395,"mutex_wait_us":29,"thread_start_us":366,"threads_started":1}
I20260806 19:33:18.572973 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.549434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45788 (local address 127.17.18.65:33453)
0806 19:33:18.562669 (+ 13235us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.562679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.562981 (+ 302us) server_negotiation.cc:407] Connection header received
0806 19:33:18.563518 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.563528 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.563903 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.564899 (+ 996us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:18.565171 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.566761 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.569345 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.570850 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.572081 (+ 1231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.572332 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.572403 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.572590 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13014,"thread_start_us":13287,"threads_started":1}
I20260806 19:33:18.576951 15043 tablet_service.cc:1467] Processing CreateTablet for tablet 79920da9a49743e3b2e367431c0e73db (DEFAULT_TABLE table=test-table [id=66b5ef776e4449ee8ee3bd60e67e7441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:18.576951 14656 tablet_service.cc:1467] Processing CreateTablet for tablet 79920da9a49743e3b2e367431c0e73db (DEFAULT_TABLE table=test-table [id=66b5ef776e4449ee8ee3bd60e67e7441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 19:33:18.578714 14656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79920da9a49743e3b2e367431c0e73db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:18.578708 15043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79920da9a49743e3b2e367431c0e73db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:18.583101 15159 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Bootstrap starting.
I20260806 19:33:18.587952 15159 tablet_bootstrap.cc:654] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:18.589114 15159 log.cc:824] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:18.592468 15159 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: No bootstrap required, opened a new log
I20260806 19:33:18.592814 15159 ts_tablet_manager.cc:1397] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 19:33:18.595688 15161 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Bootstrap starting.
I20260806 19:33:18.598275 15162 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Bootstrap starting.
I20260806 19:33:18.600148 15161 tablet_bootstrap.cc:654] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:18.601776 15161 log.cc:824] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:18.601928 15162 tablet_bootstrap.cc:654] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:18.603314 15162 log.cc:824] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:18.603540 15159 raft_consensus.cc:348] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.604236 15159 raft_consensus.cc:374] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:18.604418 15159 raft_consensus.cc:729] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3358566ecbd4fcfb46de4cea96edc0e, State: Initialized, Role: FOLLOWER
I20260806 19:33:18.605324 15159 consensus_queue.cc:260] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.606521 15162 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: No bootstrap required, opened a new log
I20260806 19:33:18.606606 15161 tablet_bootstrap.cc:492] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: No bootstrap required, opened a new log
I20260806 19:33:18.606842 15162 ts_tablet_manager.cc:1397] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 19:33:18.606940 15161 ts_tablet_manager.cc:1397] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260806 19:33:18.610888 14949 heartbeater.cc:503] Master 127.17.18.126:41063 was elected leader, sending a full tablet report...
I20260806 19:33:18.611806 15159 ts_tablet_manager.cc:1428] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
I20260806 19:33:18.618665 15162 raft_consensus.cc:348] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.618665 15161 raft_consensus.cc:348] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.619237 15161 raft_consensus.cc:374] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:18.619237 15162 raft_consensus.cc:374] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:18.619360 15161 raft_consensus.cc:729] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f28ffc8e6f94789ad7416a43fdc7d8c, State: Initialized, Role: FOLLOWER
I20260806 19:33:18.619355 15162 raft_consensus.cc:729] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef912f5492a4962b0a65fe07b036c7f, State: Initialized, Role: FOLLOWER
I20260806 19:33:18.620092 15161 consensus_queue.cc:260] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.620092 15162 consensus_queue.cc:260] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.621944 15138 heartbeater.cc:503] Master 127.17.18.126:41063 was elected leader, sending a full tablet report...
I20260806 19:33:18.622368 15162 ts_tablet_manager.cc:1428] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260806 19:33:18.622531 15161 ts_tablet_manager.cc:1428] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Time spent starting tablet: real 0.015s user 0.015s sys 0.001s
I20260806 19:33:18.640753 15165 raft_consensus.cc:482] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 19:33:18.641093 15165 raft_consensus.cc:504] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.643092 15165 leader_election.cc:288] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ef912f5492a4962b0a65fe07b036c7f (127.17.18.65:33453), 1f28ffc8e6f94789ad7416a43fdc7d8c (127.17.18.67:43047)
I20260806 19:33:18.650388 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.643531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:35911 (local address 127.17.18.65:33453)
0806 19:33:18.643757 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.643763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.644616 (+ 853us) server_negotiation.cc:407] Connection header received
0806 19:33:18.644789 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.644793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.644871 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.644953 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:18.645721 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.646430 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.648576 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.649433 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.649610 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.649689 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.649982 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.650118 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:33:18.650408 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.643671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.18.66:46535 (local address 127.17.18.67:43047)
0806 19:33:18.643874 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.643881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.644567 (+ 686us) server_negotiation.cc:407] Connection header received
0806 19:33:18.644772 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.644776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.644841 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.644920 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 19:33:18.645654 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.646389 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.648617 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.649499 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.649684 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.649757 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.650031 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.650165 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:33:18.650733 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.643398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.67:43047 (local address 127.17.18.66:46535)
0806 19:33:18.644429 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.644446 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.644620 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.644962 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.644966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.644990 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:18.645497 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.645508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.646532 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.646537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.648355 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.648369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.649695 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.649701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.649872 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.649897 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.649977 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.650109 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"mutex_wait_us":38,"thread_start_us":695,"threads_started":1}
I20260806 19:33:18.650734 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.643528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.17.18.66:35911)
0806 19:33:18.644496 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.644512 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 19:33:18.644647 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:33:18.644983 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:33:18.644987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:33:18.645012 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 19:33:18.645540 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.645552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.646571 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.646576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.648342 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:33:18.648359 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.649644 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.649650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:33:18.649820 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.649848 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 19:33:18.649937 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 19:33:18.650084 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":88,"thread_start_us":490,"threads_started":1}
I20260806 19:33:18.651842 14684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79920da9a49743e3b2e367431c0e73db" candidate_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef912f5492a4962b0a65fe07b036c7f" is_pre_election: true
I20260806 19:33:18.652127 15069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79920da9a49743e3b2e367431c0e73db" candidate_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" is_pre_election: true
I20260806 19:33:18.652403 14684 raft_consensus.cc:2454] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3358566ecbd4fcfb46de4cea96edc0e in term 0.
I20260806 19:33:18.652659 15069 raft_consensus.cc:2454] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3358566ecbd4fcfb46de4cea96edc0e in term 0.
I20260806 19:33:18.653149 14780 leader_election.cc:302] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ef912f5492a4962b0a65fe07b036c7f, c3358566ecbd4fcfb46de4cea96edc0e; no voters:
I20260806 19:33:18.653611 15165 raft_consensus.cc:2781] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 19:33:18.653810 15165 raft_consensus.cc:482] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 19:33:18.653926 15165 raft_consensus.cc:3037] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:18.656379 15165 raft_consensus.cc:504] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.657007 15165 leader_election.cc:288] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [CANDIDATE]: Term 1 election: Requested vote from peers 3ef912f5492a4962b0a65fe07b036c7f (127.17.18.65:33453), 1f28ffc8e6f94789ad7416a43fdc7d8c (127.17.18.67:43047)
I20260806 19:33:18.657691 15069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79920da9a49743e3b2e367431c0e73db" candidate_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c"
I20260806 19:33:18.657691 14684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79920da9a49743e3b2e367431c0e73db" candidate_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ef912f5492a4962b0a65fe07b036c7f"
I20260806 19:33:18.657944 15069 raft_consensus.cc:3037] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:18.657944 14684 raft_consensus.cc:3037] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:18.661589 15069 raft_consensus.cc:2454] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3358566ecbd4fcfb46de4cea96edc0e in term 1.
I20260806 19:33:18.661589 14684 raft_consensus.cc:2454] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3358566ecbd4fcfb46de4cea96edc0e in term 1.
I20260806 19:33:18.662268 14778 leader_election.cc:302] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1f28ffc8e6f94789ad7416a43fdc7d8c, 3ef912f5492a4962b0a65fe07b036c7f, c3358566ecbd4fcfb46de4cea96edc0e; no voters:
I20260806 19:33:18.662670 15165 raft_consensus.cc:2781] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:18.663232 15165 raft_consensus.cc:686] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 1 LEADER]: Becoming Leader. State: Replica: c3358566ecbd4fcfb46de4cea96edc0e, State: Running, Role: LEADER
I20260806 19:33:18.663822 15165 consensus_queue.cc:237] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } }
I20260806 19:33:18.669209 14475 catalog_manager.cc:5495] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3358566ecbd4fcfb46de4cea96edc0e (127.17.18.66). New cstate: current_term: 1 leader_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3358566ecbd4fcfb46de4cea96edc0e" member_type: VOTER last_known_addr { host: "127.17.18.66" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 } health_report { overall_health: UNKNOWN } } }
I20260806 19:33:18.691848 15154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.686372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.17.18.66:33861)
0806 19:33:18.686609 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.686614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.686633 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:33:18.686798 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.686802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.686909 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.687044 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:33:18.687358 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.688080 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.689626 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.690100 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.690208 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.690723 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:33:18.691315 (+ 592us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:33:18.691444 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.691489 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.691564 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 19:33:18.700987 14684 raft_consensus.cc:1261] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 1 FOLLOWER]: Refusing update from remote peer c3358566ecbd4fcfb46de4cea96edc0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:18.700999 15069 raft_consensus.cc:1261] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 1 FOLLOWER]: Refusing update from remote peer c3358566ecbd4fcfb46de4cea96edc0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:33:18.702157 15173 consensus_queue.cc:1035] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ef912f5492a4962b0a65fe07b036c7f" member_type: VOTER last_known_addr { host: "127.17.18.65" port: 33453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:18.702546 15165 consensus_queue.cc:1035] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f28ffc8e6f94789ad7416a43fdc7d8c" member_type: VOTER last_known_addr { host: "127.17.18.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:33:18.730445 14473 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:18.730726 14473 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38904:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 19:33:18.734858 14473 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77f2d6e0728b48c895337f017e4b78d9: Sending DeleteTablet for 3 replicas of tablet 79920da9a49743e3b2e367431c0e73db
I20260806 19:33:18.736075 14843 tablet_service.cc:1514] Processing DeleteTablet for tablet 79920da9a49743e3b2e367431c0e73db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:18 UTC) from {username='slave'} at 127.0.0.1:58102
I20260806 19:33:18.736250 14656 tablet_service.cc:1514] Processing DeleteTablet for tablet 79920da9a49743e3b2e367431c0e73db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:18 UTC) from {username='slave'} at 127.0.0.1:45788
I20260806 19:33:18.736557 15043 tablet_service.cc:1514] Processing DeleteTablet for tablet 79920da9a49743e3b2e367431c0e73db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 19:33:18 UTC) from {username='slave'} at 127.0.0.1:38002
I20260806 19:33:18.739013 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 14567
I20260806 19:33:18.747267 15191 tablet_replica.cc:330] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: stopping tablet replica
I20260806 19:33:18.748803 15191 raft_consensus.cc:2229] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:18.750360 15191 raft_consensus.cc:2258] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:18.751127 15190 tablet_replica.cc:330] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: stopping tablet replica
I20260806 19:33:18.751816 15190 raft_consensus.cc:2229] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 19:33:18.752851 15190 raft_consensus.cc:2258] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:18.757687 15190 ts_tablet_manager.cc:1905] T 79920da9a49743e3b2e367431c0e73db P 3ef912f5492a4962b0a65fe07b036c7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:18.758067 15191 ts_tablet_manager.cc:1905] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:18.758922 15189 tablet_replica.cc:330] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: stopping tablet replica
I20260806 19:33:18.761523 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.740705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.17.18.65:33453)
0806 19:33:18.740909 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.740916 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.751633 (+ 10717us) server_negotiation.cc:407] Connection header received
0806 19:33:18.752183 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.752190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.752307 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.752392 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:18.753442 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.754665 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.756655 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.757322 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.757482 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.759496 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:18.759510 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:18.759530 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:18.760396 (+ 866us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:18.760487 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:18.760517 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:18.760641 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.760926 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.761069 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:33:18.763006 14740 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:18.763211 15189 raft_consensus.cc:2229] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 1 LEADER]: Raft consensus shutting down.
I20260806 19:33:18.764312 15189 raft_consensus.cc:2258] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 19:33:18.766355 15191 ts_tablet_manager.cc:1918] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:18.766600 15191 log.cc:1196] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-2/wal/wals/79920da9a49743e3b2e367431c0e73db
I20260806 19:33:18.767174 15189 ts_tablet_manager.cc:1905] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 19:33:18.767269 15191 ts_tablet_manager.cc:1939] T 79920da9a49743e3b2e367431c0e73db P 1f28ffc8e6f94789ad7416a43fdc7d8c: Deleting consensus metadata
I20260806 19:33:18.769567 14453 catalog_manager.cc:4841] TS 1f28ffc8e6f94789ad7416a43fdc7d8c (127.17.18.67:43047): tablet 79920da9a49743e3b2e367431c0e73db (table test-table [id=66b5ef776e4449ee8ee3bd60e67e7441]) successfully deleted
I20260806 19:33:18.776194 15189 ts_tablet_manager.cc:1918] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 19:33:18.776432 15189 log.cc:1196] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Deleting WAL directory at /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786044445493736-17481-0/minicluster-data/ts-1/wal/wals/79920da9a49743e3b2e367431c0e73db
I20260806 19:33:18.777045 15189 ts_tablet_manager.cc:1939] T 79920da9a49743e3b2e367431c0e73db P c3358566ecbd4fcfb46de4cea96edc0e: Deleting consensus metadata
I20260806 19:33:18.779249 14452 catalog_manager.cc:4841] TS c3358566ecbd4fcfb46de4cea96edc0e (127.17.18.66:33861): tablet 79920da9a49743e3b2e367431c0e73db (table test-table [id=66b5ef776e4449ee8ee3bd60e67e7441]) successfully deleted
I20260806 19:33:18.882727 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 14567
W20260806 19:33:18.908524 14456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.18.65:33453 (error 108)
I20260806 19:33:18.909265 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 14756
I20260806 19:33:18.910795 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.910219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45808)
0806 19:33:18.910498 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.910629 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260806 19:33:18.911059 14456 catalog_manager.cc:4584] TS 3ef912f5492a4962b0a65fe07b036c7f (127.17.18.65:33453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 79920da9a49743e3b2e367431c0e73db: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
I20260806 19:33:18.918751 15154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.910413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58126 (local address 127.17.18.66:33861)
0806 19:33:18.910632 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:18.910638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:18.910659 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:33:18.910737 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:18.910743 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:18.910850 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:18.910957 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:18.911657 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.912510 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.914541 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:18.915037 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:18.915144 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:18.916515 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:18.916529 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:18.916550 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:18.917278 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:18.917333 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:18.917361 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:18.917524 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:18.918077 (+ 553us) server_negotiation.cc:299] Negotiation successful
0806 19:33:18.918190 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 19:33:18.919646 14937 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:18.964856 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.964332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45822)
0806 19:33:18.964560 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.964673 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 19:33:18.966142 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:18.965696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45838)
0806 19:33:18.965876 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:18.965956 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 19:33:19.027343 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.026802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45846)
0806 19:33:19.027071 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:19.027183 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 19:33:19.028604 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.028120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45860)
0806 19:33:19.028310 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:19.028399 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 19:33:19.042635 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 14756
I20260806 19:33:19.071171 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 14953
I20260806 19:33:19.078462 15157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.071974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38016 (local address 127.17.18.67:43047)
0806 19:33:19.072184 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:19.072190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:19.072212 (+ 22us) server_negotiation.cc:407] Connection header received
0806 19:33:19.072420 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:19.072427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:19.072524 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:19.072632 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:19.073079 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:19.073899 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:19.075225 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:19.075632 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:19.075765 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:19.076894 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:19.076905 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:19.076924 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:19.077652 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:19.077705 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:19.077736 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:19.077855 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:19.077982 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 19:33:19.078138 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:33:19.079228 15132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:19.109366 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.108810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45864)
0806 19:33:19.109083 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:19.109198 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 19:33:19.110512 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.110090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45866)
0806 19:33:19.110295 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:19.110380 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 19:33:19.172977 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 14953
I20260806 19:33:19.201251 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 14429
I20260806 19:33:19.202488 14522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:19.324431 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:19.323795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.65:33453 (local address 127.0.0.1:45878)
0806 19:33:19.324061 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 19:33:19.324203 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.65:33453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260806 19:33:19.324651 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 14429
2026-08-06T19:33:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3119 ms)
[----------] 6 tests from EncryptionPolicyTest (24641 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:19 dist-test-slave-f0tn krb5kdc[15207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:19 dist-test-slave-f0tn krb5kdc[15207](info): set up 2 sockets
Aug 06 19:33:19 dist-test-slave-f0tn krb5kdc[15207](info): commencing operation
krb5kdc: starting...
W20260806 19:33:20.608595 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:20 dist-test-slave-f0tn krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:20.977231 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:21.366458 15229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:21.366765 15229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:21.366858 15229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:21.374354 15229 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:21.374482 15229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:21.374531 15229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:21.374593 15229 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:21.374637 15229 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:21.385159 15229 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38597
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:21.386569 15229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:21.387899 15229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:21.403661 15234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:21.403750 15235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:21.404803 15237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:21.404940 15229 server_base.cc:1034] running on GCE node
I20260806 19:33:21.406006 15229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:21.407532 15229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:21.408769 15229 hybrid_clock.cc:648] HybridClock initialized: now 1786044801408717 us; error 39 us; skew 500 ppm
I20260806 19:33:21.409183 15229 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:21 dist-test-slave-f0tn krb5kdc[15207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044801, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:21.412562 15229 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:21.414296 15229 webserver.cc:460] Webserver started at http://127.0.0.1:35523/ using document root <none> and password file <none>
I20260806 19:33:21.415022 15229 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:21.415155 15229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:21.415491 15229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:21.418807 15229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "bd7b99964a0b4c8aba6321603628588c"
format_stamp: "Formatted at 2026-08-06 19:33:21 on dist-test-slave-f0tn"
server_key: "8cac67912a635910588f5a6da8125e9b"
server_key_iv: "1b44b4c33d19e6494fe228c9c17ec35f"
server_key_version: "encryptionkey@0"
I20260806 19:33:21.419631 15229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "bd7b99964a0b4c8aba6321603628588c"
format_stamp: "Formatted at 2026-08-06 19:33:21 on dist-test-slave-f0tn"
server_key: "8cac67912a635910588f5a6da8125e9b"
server_key_iv: "1b44b4c33d19e6494fe228c9c17ec35f"
server_key_version: "encryptionkey@0"
I20260806 19:33:21.425325 15229 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 19:33:21.429031 15248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:21.430454 15229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:21.430625 15229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "bd7b99964a0b4c8aba6321603628588c"
format_stamp: "Formatted at 2026-08-06 19:33:21 on dist-test-slave-f0tn"
server_key: "8cac67912a635910588f5a6da8125e9b"
server_key_iv: "1b44b4c33d19e6494fe228c9c17ec35f"
server_key_version: "encryptionkey@0"
I20260806 19:33:21.430821 15229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:21.458866 15229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:21.463421 15229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:21.463726 15229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:21.482585 15229 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38597
I20260806 19:33:21.482625 15318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38597 every 8 connection(s)
I20260806 19:33:21.484163 15229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:21.485785 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 15229
I20260806 19:33:21.486024 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:21.486825 17481 external_mini_cluster.cc:1428] Setting key a6864dbb0049733a72a57047823874b1
I20260806 19:33:21.489320 15319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:33:21 dist-test-slave-f0tn krb5kdc[15207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 19:33:21.502058 15319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c: Bootstrap starting.
I20260806 19:33:21.506418 15319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:21.507822 15319 log.cc:824] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:21.511803 15319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c: No bootstrap required, opened a new log
I20260806 19:33:21.512396 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:21.488950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37421 (local address 127.0.0.1:38597)
0806 19:33:21.489855 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:21.489868 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:21.489912 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:33:21.491625 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:21.491649 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:21.492079 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:21.492511 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:21.494156 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:21.495614 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:21.497066 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:21.498238 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:21.498471 (+ 233us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:21.502936 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:21.502948 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:21.502970 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:21.503032 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:21.507084 (+ 4052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:21.508056 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:21.508065 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:21.508075 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:21.508322 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:21.508969 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:21.508972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:21.508975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:21.509759 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:21.510098 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:21.510544 (+ 446us) server_negotiation.cc:299] Negotiation successful
0806 19:33:21.510927 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":398,"threads_started":1}
I20260806 19:33:21.516911 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:21.521800 15319 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } }
I20260806 19:33:21.522373 15319 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:21.522495 15319 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd7b99964a0b4c8aba6321603628588c, State: Initialized, Role: FOLLOWER
I20260806 19:33:21.523267 15319 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } }
I20260806 19:33:21.523543 15319 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:21.523720 15319 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:21.523912 15319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:21.526878 15319 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } }
I20260806 19:33:21.527460 15319 leader_election.cc:302] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd7b99964a0b4c8aba6321603628588c; no voters:
I20260806 19:33:21.528115 15319 leader_election.cc:288] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:21.528261 15331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:21.530675 15319 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:21.531826 15331 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [term 1 LEADER]: Becoming Leader. State: Replica: bd7b99964a0b4c8aba6321603628588c, State: Running, Role: LEADER
I20260806 19:33:21.532505 15331 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } }
I20260806 19:33:21.535835 15333 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd7b99964a0b4c8aba6321603628588c. Latest consensus state: current_term: 1 leader_uuid: "bd7b99964a0b4c8aba6321603628588c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } } }
I20260806 19:33:21.536269 15333 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:21.537354 15332 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd7b99964a0b4c8aba6321603628588c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd7b99964a0b4c8aba6321603628588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38597 } } }
I20260806 19:33:21.537693 15332 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:21.542124 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:21.523135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34421 (local address 127.0.0.1:38597)
0806 19:33:21.523333 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:21.523339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:21.523671 (+ 332us) server_negotiation.cc:407] Connection header received
0806 19:33:21.523889 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:21.523894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:21.523984 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:21.524106 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:21.525573 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:21.526729 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:21.528074 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:21.528779 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:21.529622 (+ 843us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:21.531781 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:21.531788 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:21.531793 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:21.531841 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:21.536048 (+ 4207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:21.537838 (+ 1790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:21.537845 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:21.537849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:21.538097 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:21.538777 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:21.538782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:21.538786 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:21.539234 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:21.540937 (+ 1703us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:21.541142 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 19:33:21.541417 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":71}
I20260806 19:33:21.544170 15344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:21.549839 15344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:21.559939 15344 catalog_manager.cc:1347] Generated new cluster ID: 3d5d69005e394f299b649934ac4b2534
I20260806 19:33:21.560083 15344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:21.569096 15344 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:21.570513 15344 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:21.588742 15344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd7b99964a0b4c8aba6321603628588c: Generated new TSK 0
I20260806 19:33:21.590240 15344 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:21.608248 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15229
I20260806 19:33:21.610473 15314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:21.709270 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 15229
W20260806 19:33:21.734700 15203 connection.cc:535] client connection to 127.0.0.1:38597 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38597): Connection reset by peer (error 104)
2026-08-06T19:33:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2369 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:21 dist-test-slave-f0tn krb5kdc[15358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:21 dist-test-slave-f0tn krb5kdc[15358](info): set up 2 sockets
Aug 06 19:33:21 dist-test-slave-f0tn krb5kdc[15358](info): commencing operation
krb5kdc: starting...
W20260806 19:33:22.977659 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:23 dist-test-slave-f0tn krb5kdc[15358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:23.353243 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37025
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:23.716780 15375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:23.717173 15375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:23.717325 15375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:23.725262 15375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:23.725461 15375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:23.725544 15375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:23.725632 15375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:23.725694 15375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:23.736428 15375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37025
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:23.738044 15375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:23.739578 15375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:23.752324 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:23.752295 15387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:23.752257 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:23.753055 15375 server_base.cc:1034] running on GCE node
I20260806 19:33:23.753994 15375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:23.755544 15375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:23.756791 15375 hybrid_clock.cc:648] HybridClock initialized: now 1786044803756728 us; error 51 us; skew 500 ppm
I20260806 19:33:23.757186 15375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:23 dist-test-slave-f0tn krb5kdc[15358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044803, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:23.760528 15375 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:23.762164 15375 webserver.cc:460] Webserver started at http://127.0.0.1:40991/ using document root <none> and password file <none>
I20260806 19:33:23.763080 15375 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:23.763236 15375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:23.763586 15375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:23.766966 15375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "99c027a8ffef4e49a599211a643833f9"
format_stamp: "Formatted at 2026-08-06 19:33:23 on dist-test-slave-f0tn"
server_key: "e7cc591b48d563216e219871be88f52a"
server_key_iv: "4a83befb98941091304eee16b6fb75a2"
server_key_version: "encryptionkey@0"
I20260806 19:33:23.767870 15375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "99c027a8ffef4e49a599211a643833f9"
format_stamp: "Formatted at 2026-08-06 19:33:23 on dist-test-slave-f0tn"
server_key: "e7cc591b48d563216e219871be88f52a"
server_key_iv: "4a83befb98941091304eee16b6fb75a2"
server_key_version: "encryptionkey@0"
I20260806 19:33:23.774075 15375 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 19:33:23.778071 15399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:23.779616 15375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:23.779825 15375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "99c027a8ffef4e49a599211a643833f9"
format_stamp: "Formatted at 2026-08-06 19:33:23 on dist-test-slave-f0tn"
server_key: "e7cc591b48d563216e219871be88f52a"
server_key_iv: "4a83befb98941091304eee16b6fb75a2"
server_key_version: "encryptionkey@0"
I20260806 19:33:23.780045 15375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:23.796087 15375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:23.800740 15375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:23.801033 15375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:23.820868 15375 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37025
I20260806 19:33:23.820923 15463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37025 every 8 connection(s)
I20260806 19:33:23.822480 15375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:23.826617 15464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:23.830016 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 15375
I20260806 19:33:23.830248 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:23.830804 17481 external_mini_cluster.cc:1428] Setting key cde6733162ff490b440bb25b94a2df00
I20260806 19:33:23.840169 15464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9: Bootstrap starting.
I20260806 19:33:23.844164 15464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:23.845016 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:23.832966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49067 (local address 127.0.0.1:37025)
0806 19:33:23.833871 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:23.833885 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:23.833926 (+ 41us) server_negotiation.cc:407] Connection header received
0806 19:33:23.835687 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:23.835713 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:23.836151 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:23.836537 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:23.837111 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:23.838587 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:23.839983 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:23.840764 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:23.840948 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:23.842424 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:23.842432 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:23.842449 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:23.843046 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:23.843143 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:23.843178 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:23.843333 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:23.843635 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 19:33:23.843821 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":408,"threads_started":1}
I20260806 19:33:23.845566 15464 log.cc:824] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:23.848992 15464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9: No bootstrap required, opened a new log
I20260806 19:33:23.849285 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:23.858271 15464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } }
I20260806 19:33:23.858779 15464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:23.858904 15464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99c027a8ffef4e49a599211a643833f9, State: Initialized, Role: FOLLOWER
I20260806 19:33:23.859670 15464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } }
I20260806 19:33:23.859992 15464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:23.860157 15464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:23.860366 15464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:23.860677 15468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:23.853925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39973 (local address 127.0.0.1:37025)
0806 19:33:23.854163 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:23.854171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:23.854561 (+ 390us) server_negotiation.cc:407] Connection header received
0806 19:33:23.854771 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:23.854779 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:23.854854 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:23.854945 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:23.855503 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:23.856339 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:23.857792 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:23.858253 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:23.858374 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:23.859660 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:23.859665 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:23.859668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:23.859689 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:23.859751 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:23.859768 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:23.859881 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:23.860234 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 19:33:23.860293 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 19:33:23.863417 15464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } }
I20260806 19:33:23.864056 15464 leader_election.cc:302] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99c027a8ffef4e49a599211a643833f9; no voters:
I20260806 19:33:23.864760 15464 leader_election.cc:288] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:23.864866 15479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:23.865628 15479 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [term 1 LEADER]: Becoming Leader. State: Replica: 99c027a8ffef4e49a599211a643833f9, State: Running, Role: LEADER
I20260806 19:33:23.866333 15479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } }
I20260806 19:33:23.867573 15464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:23.869339 15480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99c027a8ffef4e49a599211a643833f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } } }
I20260806 19:33:23.869316 15481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99c027a8ffef4e49a599211a643833f9. Latest consensus state: current_term: 1 leader_uuid: "99c027a8ffef4e49a599211a643833f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99c027a8ffef4e49a599211a643833f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37025 } } }
I20260806 19:33:23.869859 15480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:23.869868 15481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:23.870774 15486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:23.876574 15486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:23.888094 15486 catalog_manager.cc:1347] Generated new cluster ID: 6fb848ac09084fd18290d21d7f5ecc8b
I20260806 19:33:23.888262 15486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:23.902844 15486 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:23.904428 15486 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:23.916422 15486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99c027a8ffef4e49a599211a643833f9: Generated new TSK 0
I20260806 19:33:23.917735 15486 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:23.931239 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15375
W20260806 19:33:23.933645 15459 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49067
W20260806 19:33:23.934500 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15375: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:23.934674 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 15375
W20260806 19:33:23.962999 15356 connection.cc:535] client connection to 127.0.0.1:37025 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37025): Connection reset by peer (error 104)
2026-08-06T19:33:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2228 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:24 dist-test-slave-f0tn krb5kdc[15510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:24 dist-test-slave-f0tn krb5kdc[15510](info): set up 2 sockets
Aug 06 19:33:24 dist-test-slave-f0tn krb5kdc[15510](info): commencing operation
krb5kdc: starting...
W20260806 19:33:25.196973 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:25 dist-test-slave-f0tn krb5kdc[15510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:25.566968 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32893
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:25.941354 15528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:25.941780 15528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:25.941920 15528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:25.949608 15528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:25.949749 15528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:25.949797 15528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:25.949862 15528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:25.949908 15528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:25.960569 15528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:25.962060 15528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:25.963470 15528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:25.977020 15538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:25.976929 15537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:25.976994 15541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:25.978250 15528 server_base.cc:1034] running on GCE node
I20260806 19:33:25.979421 15528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:25.982549 15528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:25.983958 15528 hybrid_clock.cc:648] HybridClock initialized: now 1786044805983903 us; error 49 us; skew 500 ppm
I20260806 19:33:25.984476 15528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:25 dist-test-slave-f0tn krb5kdc[15510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044805, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:25.992444 15528 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:25.994624 15528 webserver.cc:460] Webserver started at http://127.0.0.1:34617/ using document root <none> and password file <none>
I20260806 19:33:25.995445 15528 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:25.995587 15528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:25.995925 15528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:25.999459 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f"
format_stamp: "Formatted at 2026-08-06 19:33:25 on dist-test-slave-f0tn"
server_key: "769d96c5b1ad2cad8558cbd5893fabbd"
server_key_iv: "dda21de4ac4b022b063aa918a1187cc9"
server_key_version: "encryptionkey@0"
I20260806 19:33:26.000434 15528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f"
format_stamp: "Formatted at 2026-08-06 19:33:25 on dist-test-slave-f0tn"
server_key: "769d96c5b1ad2cad8558cbd5893fabbd"
server_key_iv: "dda21de4ac4b022b063aa918a1187cc9"
server_key_version: "encryptionkey@0"
I20260806 19:33:26.007124 15528 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 19:33:26.011354 15556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:26.013123 15528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:33:26.013844 15528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f"
format_stamp: "Formatted at 2026-08-06 19:33:25 on dist-test-slave-f0tn"
server_key: "769d96c5b1ad2cad8558cbd5893fabbd"
server_key_iv: "dda21de4ac4b022b063aa918a1187cc9"
server_key_version: "encryptionkey@0"
I20260806 19:33:26.014106 15528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:26.022912 15528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:26.028716 15528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:26.029085 15528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:26.053922 15528 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32893
I20260806 19:33:26.053992 15625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32893 every 8 connection(s)
I20260806 19:33:26.055760 15528 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:26.060051 15626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:26.066268 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 15528
I20260806 19:33:26.066510 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:26.067101 17481 external_mini_cluster.cc:1428] Setting key 5cb7bcef9b870687af72e1ffa3158197
I20260806 19:33:26.074395 15626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f: Bootstrap starting.
I20260806 19:33:26.077564 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:26.069590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35545 (local address 127.0.0.1:32893)
0806 19:33:26.070513 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:26.070531 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:26.070586 (+ 55us) server_negotiation.cc:407] Connection header received
0806 19:33:26.072939 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:26.072972 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:26.073678 (+ 706us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:26.074106 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:26.075451 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:26.075459 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:26.075474 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:26.075502 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:26.075600 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:26.075624 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:26.075812 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:26.075969 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 19:33:26.076197 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":410,"threads_started":1}
I20260806 19:33:26.078428 15626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:26.079608 15626 log.cc:824] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:26.081866 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:26.082886 15626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f: No bootstrap required, opened a new log
I20260806 19:33:26.089459 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:26.086573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51731 (local address 127.0.0.1:32893)
0806 19:33:26.086752 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:26.086757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:26.087156 (+ 399us) server_negotiation.cc:407] Connection header received
0806 19:33:26.087320 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:26.087324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:26.087392 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:26.087493 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:26.088567 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:26.088572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:26.088575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:26.088597 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:26.088655 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:26.088678 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:26.088807 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:26.089007 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 19:33:26.089095 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 19:33:26.092593 15626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } }
I20260806 19:33:26.093060 15626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:26.093171 15626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0cf0b577cb4affb0c6e6fd94c6404f, State: Initialized, Role: FOLLOWER
I20260806 19:33:26.093895 15626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } }
I20260806 19:33:26.094165 15626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:26.094312 15626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:26.094504 15626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:26.096956 15626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } }
I20260806 19:33:26.097608 15626 leader_election.cc:302] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b0cf0b577cb4affb0c6e6fd94c6404f; no voters:
I20260806 19:33:26.098393 15626 leader_election.cc:288] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:26.098559 15641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:26.099325 15641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [term 1 LEADER]: Becoming Leader. State: Replica: 0b0cf0b577cb4affb0c6e6fd94c6404f, State: Running, Role: LEADER
I20260806 19:33:26.099985 15641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } }
I20260806 19:33:26.100725 15626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:26.103334 15643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b0cf0b577cb4affb0c6e6fd94c6404f. Latest consensus state: current_term: 1 leader_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } } }
I20260806 19:33:26.103729 15643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:26.104781 15642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b0cf0b577cb4affb0c6e6fd94c6404f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32893 } } }
I20260806 19:33:26.105237 15642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:26.105526 15650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:26.111413 15650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:26.122082 15650 catalog_manager.cc:1347] Generated new cluster ID: 9ea38ece9a3c4239abd87543661d0a3b
I20260806 19:33:26.122236 15650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:26.135133 15650 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:26.135818 15650 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:26.147614 15650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b0cf0b577cb4affb0c6e6fd94c6404f: Generated new TSK 0
I20260806 19:33:26.148674 15650 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:26.163668 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15528
W20260806 19:33:26.164973 15620 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35545
W20260806 19:33:26.165746 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15528: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:26.165885 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 15528
2026-08-06T19:33:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2231 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:26 dist-test-slave-f0tn krb5kdc[15670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:26 dist-test-slave-f0tn krb5kdc[15670](info): set up 2 sockets
Aug 06 19:33:26 dist-test-slave-f0tn krb5kdc[15670](info): commencing operation
krb5kdc: starting...
W20260806 19:33:27.427469 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.005s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:27 dist-test-slave-f0tn krb5kdc[15670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:27.793555 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45493
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:28.171929 15684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:28.172268 15684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:28.172366 15684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:28.179935 15684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:28.180078 15684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:28.180126 15684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:28.180202 15684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:28.180248 15684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:28.191694 15684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:28.193120 15684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:28.194571 15684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:28.207360 15693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:28.207418 15695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:28.207446 15692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:28.208976 15684 server_base.cc:1034] running on GCE node
I20260806 19:33:28.210024 15684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:28.211910 15684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:28.213196 15684 hybrid_clock.cc:648] HybridClock initialized: now 1786044808213074 us; error 109 us; skew 500 ppm
I20260806 19:33:28.213666 15684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:28 dist-test-slave-f0tn krb5kdc[15670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044808, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:28.217209 15684 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:28.219478 15684 webserver.cc:460] Webserver started at http://127.0.0.1:36191/ using document root <none> and password file <none>
I20260806 19:33:28.220301 15684 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:28.220450 15684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:28.220791 15684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:28.224321 15684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "819134ce7ee740b59d193c3b4d82ecb0"
format_stamp: "Formatted at 2026-08-06 19:33:28 on dist-test-slave-f0tn"
server_key: "3179ed19166b24613830810ad2ebf9da"
server_key_iv: "f791024319c8641841d1c9a2f0569b00"
server_key_version: "encryptionkey@0"
I20260806 19:33:28.225211 15684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "819134ce7ee740b59d193c3b4d82ecb0"
format_stamp: "Formatted at 2026-08-06 19:33:28 on dist-test-slave-f0tn"
server_key: "3179ed19166b24613830810ad2ebf9da"
server_key_iv: "f791024319c8641841d1c9a2f0569b00"
server_key_version: "encryptionkey@0"
I20260806 19:33:28.231295 15684 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 19:33:28.235579 15704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:28.237238 15684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:33:28.237483 15684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "819134ce7ee740b59d193c3b4d82ecb0"
format_stamp: "Formatted at 2026-08-06 19:33:28 on dist-test-slave-f0tn"
server_key: "3179ed19166b24613830810ad2ebf9da"
server_key_iv: "f791024319c8641841d1c9a2f0569b00"
server_key_version: "encryptionkey@0"
I20260806 19:33:28.237718 15684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:28.255534 15684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:28.260233 15684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:28.260537 15684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:28.280431 15684 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45493
I20260806 19:33:28.280443 15783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45493 every 8 connection(s)
I20260806 19:33:28.282089 15684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:28.286404 15784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:28.291258 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 15684
I20260806 19:33:28.291425 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:28.291874 17481 external_mini_cluster.cc:1428] Setting key 1b53c7333c410e4b121aab20f8c1d3f0
I20260806 19:33:28.300235 15784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0: Bootstrap starting.
I20260806 19:33:28.304359 15784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:28.305847 15784 log.cc:824] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:28.309542 15784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0: No bootstrap required, opened a new log
Aug 06 19:33:28 dist-test-slave-f0tn krb5kdc[15670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 19:33:28.320644 15784 raft_consensus.cc:348] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } }
I20260806 19:33:28.321202 15784 raft_consensus.cc:374] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:28.321331 15784 raft_consensus.cc:729] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 819134ce7ee740b59d193c3b4d82ecb0, State: Initialized, Role: FOLLOWER
I20260806 19:33:28.321523 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:28.294299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35983 (local address 127.0.0.1:45493)
0806 19:33:28.295314 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:28.295331 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:28.295392 (+ 61us) server_negotiation.cc:407] Connection header received
0806 19:33:28.298150 (+ 2758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:28.298202 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:28.298861 (+ 659us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:28.299399 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:28.301047 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:28.303218 (+ 2171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:28.304795 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:28.305953 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:28.306153 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:28.311008 (+ 4855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:28.311021 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:28.311044 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:28.311104 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:28.315592 (+ 4488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:28.316624 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:28.316635 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:28.316647 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:28.316911 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:28.317510 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:28.317516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:28.317520 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:28.318524 (+ 1004us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:28.318874 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:28.319421 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 19:33:28.319975 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":479,"threads_started":1}
I20260806 19:33:28.322199 15784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } }
I20260806 19:33:28.322539 15784 raft_consensus.cc:388] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:28.322698 15784 raft_consensus.cc:482] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:28.322906 15784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:28.326007 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:28.325950 15784 raft_consensus.cc:504] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } }
I20260806 19:33:28.326509 15784 leader_election.cc:302] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 819134ce7ee740b59d193c3b4d82ecb0; no voters:
I20260806 19:33:28.327163 15784 leader_election.cc:288] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:28.327311 15791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:28.329752 15784 sys_catalog.cc:564] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:28.333779 15791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [term 1 LEADER]: Becoming Leader. State: Replica: 819134ce7ee740b59d193c3b4d82ecb0, State: Running, Role: LEADER
I20260806 19:33:28.334623 15791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } }
I20260806 19:33:28.339200 15792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "819134ce7ee740b59d193c3b4d82ecb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } } }
I20260806 19:33:28.339250 15793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 819134ce7ee740b59d193c3b4d82ecb0. Latest consensus state: current_term: 1 leader_uuid: "819134ce7ee740b59d193c3b4d82ecb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "819134ce7ee740b59d193c3b4d82ecb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45493 } } }
I20260806 19:33:28.339742 15792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:28.339766 15793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:28.341482 15807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:28.348940 15807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:28.358995 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:28.330965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54821 (local address 127.0.0.1:45493)
0806 19:33:28.331163 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:28.331171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:28.338039 (+ 6868us) server_negotiation.cc:407] Connection header received
0806 19:33:28.339733 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:28.339740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:28.339840 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:28.339932 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:28.342415 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:28.343545 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:28.345501 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:28.346215 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:28.346333 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:28.350074 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:28.350084 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:28.350090 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:28.350143 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:28.354206 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:28.355321 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:28.355333 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:28.355336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:28.355513 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:28.356045 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:28.356051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:28.356054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:28.356517 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:28.356776 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:28.358307 (+ 1531us) server_negotiation.cc:299] Negotiation successful
0806 19:33:28.358586 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 19:33:28.365470 15807 catalog_manager.cc:1347] Generated new cluster ID: 4c6a6616bd224c038cc2c5d7b47c850a
I20260806 19:33:28.365640 15807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:28.383769 15807 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:28.385241 15807 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:28.391856 15807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 819134ce7ee740b59d193c3b4d82ecb0: Generated new TSK 0
I20260806 19:33:28.392810 15807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:28.401870 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15684
I20260806 19:33:28.403061 15778 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:28.495857 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 15684
2026-08-06T19:33:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:28 dist-test-slave-f0tn krb5kdc[15829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:28 dist-test-slave-f0tn krb5kdc[15829](info): set up 2 sockets
Aug 06 19:33:28 dist-test-slave-f0tn krb5kdc[15829](info): commencing operation
krb5kdc: starting...
W20260806 19:33:29.769513 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.001s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:30 dist-test-slave-f0tn krb5kdc[15829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:30.145771 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44355
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:30.525242 15845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:30.525645 15845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:30.525803 15845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:30.533595 15845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:30.533737 15845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:30.533798 15845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:30.533886 15845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:30.533946 15845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:30.544925 15845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:30.546414 15845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:30.547850 15845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:30.560892 15857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:30.560915 15853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:30.560848 15854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:30.561965 15845 server_base.cc:1034] running on GCE node
I20260806 19:33:30.562935 15845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:30.564674 15845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:30.565928 15845 hybrid_clock.cc:648] HybridClock initialized: now 1786044810565878 us; error 38 us; skew 500 ppm
I20260806 19:33:30.566365 15845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:30 dist-test-slave-f0tn krb5kdc[15829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044810, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:30.570106 15845 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:30.572018 15845 webserver.cc:460] Webserver started at http://127.0.0.1:36891/ using document root <none> and password file <none>
I20260806 19:33:30.572806 15845 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:30.572944 15845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:30.573272 15845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:30.576786 15845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "edf64c983ee14dff9bb78dc1d13781d7"
format_stamp: "Formatted at 2026-08-06 19:33:30 on dist-test-slave-f0tn"
server_key: "f2e4dbcec5d00aa02fd9f955edcd681a"
server_key_iv: "0094e38e8e0f48ab27dd02587616356b"
server_key_version: "encryptionkey@0"
I20260806 19:33:30.577769 15845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "edf64c983ee14dff9bb78dc1d13781d7"
format_stamp: "Formatted at 2026-08-06 19:33:30 on dist-test-slave-f0tn"
server_key: "f2e4dbcec5d00aa02fd9f955edcd681a"
server_key_iv: "0094e38e8e0f48ab27dd02587616356b"
server_key_version: "encryptionkey@0"
I20260806 19:33:30.583840 15845 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:33:30.588487 15866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:30.590233 15845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 19:33:30.590451 15845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "edf64c983ee14dff9bb78dc1d13781d7"
format_stamp: "Formatted at 2026-08-06 19:33:30 on dist-test-slave-f0tn"
server_key: "f2e4dbcec5d00aa02fd9f955edcd681a"
server_key_iv: "0094e38e8e0f48ab27dd02587616356b"
server_key_version: "encryptionkey@0"
I20260806 19:33:30.590689 15845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:30.608803 15845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:30.614097 15845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:30.614450 15845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:30.636368 15845 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44355
I20260806 19:33:30.636416 15941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44355 every 8 connection(s)
I20260806 19:33:30.638003 15845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:30.642488 15943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:30.644685 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 15845
I20260806 19:33:30.644886 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:30.645503 17481 external_mini_cluster.cc:1428] Setting key d8cef1e4effa208a05f3d37fc7e74230
I20260806 19:33:30.657675 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7: Bootstrap starting.
I20260806 19:33:30.659785 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:30.647540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36179 (local address 127.0.0.1:44355)
0806 19:33:30.648466 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:30.648478 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:30.648535 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:33:30.650329 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:30.650357 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:30.650850 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:30.651252 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:30.651853 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:30.653511 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:30.654979 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:30.655781 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:30.655970 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:30.657216 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:30.657226 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:30.657244 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:30.657937 (+ 693us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:30.658029 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:30.658064 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:30.658177 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:30.658427 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 19:33:30.658732 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":402,"threads_started":1}
I20260806 19:33:30.661650 15943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:30.662966 15943 log.cc:824] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:30.664359 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:30.666566 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7: No bootstrap required, opened a new log
I20260806 19:33:30.676275 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:30.668991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49467 (local address 127.0.0.1:44355)
0806 19:33:30.669224 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:30.669230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:30.669583 (+ 353us) server_negotiation.cc:407] Connection header received
0806 19:33:30.669794 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:30.669798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:30.669873 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:30.669964 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:30.670605 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:30.671390 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:30.673369 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:30.673912 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:30.674018 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:30.675361 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:30.675366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:30.675370 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:30.675396 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:30.675447 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:30.675518 (+ 71us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:30.675640 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:30.675812 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 19:33:30.675907 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:33:30.676947 15943 raft_consensus.cc:348] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } }
I20260806 19:33:30.677366 15943 raft_consensus.cc:374] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:30.677515 15943 raft_consensus.cc:729] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edf64c983ee14dff9bb78dc1d13781d7, State: Initialized, Role: FOLLOWER
I20260806 19:33:30.678117 15943 consensus_queue.cc:260] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } }
I20260806 19:33:30.678361 15943 raft_consensus.cc:388] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:30.678491 15943 raft_consensus.cc:482] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:30.678669 15943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:30.681051 15943 raft_consensus.cc:504] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } }
I20260806 19:33:30.681686 15943 leader_election.cc:302] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edf64c983ee14dff9bb78dc1d13781d7; no voters:
I20260806 19:33:30.682422 15943 leader_election.cc:288] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:30.682591 15958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:30.683817 15958 raft_consensus.cc:686] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [term 1 LEADER]: Becoming Leader. State: Replica: edf64c983ee14dff9bb78dc1d13781d7, State: Running, Role: LEADER
I20260806 19:33:30.684392 15958 consensus_queue.cc:237] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } }
I20260806 19:33:30.684826 15943 sys_catalog.cc:564] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:30.687184 15960 sys_catalog.cc:455] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edf64c983ee14dff9bb78dc1d13781d7. Latest consensus state: current_term: 1 leader_uuid: "edf64c983ee14dff9bb78dc1d13781d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } } }
I20260806 19:33:30.687753 15960 sys_catalog.cc:458] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:30.687208 15959 sys_catalog.cc:455] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edf64c983ee14dff9bb78dc1d13781d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edf64c983ee14dff9bb78dc1d13781d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44355 } } }
I20260806 19:33:30.688128 15959 sys_catalog.cc:458] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:30.690111 15965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:30.695976 15965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:30.706234 15965 catalog_manager.cc:1347] Generated new cluster ID: 4b7243a18020428e8ad6969fe429dbdb
I20260806 19:33:30.706467 15965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:30.723546 15965 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:30.725227 15965 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:30.732834 15965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edf64c983ee14dff9bb78dc1d13781d7: Generated new TSK 0
I20260806 19:33:30.733975 15965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:30.751083 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15845
W20260806 19:33:30.752358 15935 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36179
W20260806 19:33:30.753188 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 15845: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:30.753340 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 15845
2026-08-06T19:33:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2255 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:30 dist-test-slave-f0tn krb5kdc[15981](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:30 dist-test-slave-f0tn krb5kdc[15981](info): set up 2 sockets
Aug 06 19:33:30 dist-test-slave-f0tn krb5kdc[15981](info): commencing operation
krb5kdc: starting...
W20260806 19:33:32.017580 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:32 dist-test-slave-f0tn krb5kdc[15981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:32.413172 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:32.787336 16001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:32.787698 16001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:32.787801 16001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:32.795898 16001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:32.796078 16001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:32.796182 16001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:32.796273 16001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:32.796350 16001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:32.807453 16001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:32.808965 16001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:32.810570 16001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:32.823833 16010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:32.823872 16013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:32.823776 16011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:32.824709 16001 server_base.cc:1034] running on GCE node
I20260806 19:33:32.825632 16001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:32.827230 16001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:32.828452 16001 hybrid_clock.cc:648] HybridClock initialized: now 1786044812828401 us; error 43 us; skew 500 ppm
I20260806 19:33:32.828845 16001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:32 dist-test-slave-f0tn krb5kdc[15981](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044812, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:32.832334 16001 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:32.834129 16001 webserver.cc:460] Webserver started at http://127.0.0.1:33343/ using document root <none> and password file <none>
I20260806 19:33:32.834932 16001 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:32.835085 16001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:32.835419 16001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:32.838891 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "1b22c0add0b749578a6b6fde378dc49c"
format_stamp: "Formatted at 2026-08-06 19:33:32 on dist-test-slave-f0tn"
server_key: "e6f5488706adc99238a4897fa1a45d40"
server_key_iv: "b1fc26334168cb155b76e4ce85d1aea3"
server_key_version: "encryptionkey@0"
I20260806 19:33:32.839773 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "1b22c0add0b749578a6b6fde378dc49c"
format_stamp: "Formatted at 2026-08-06 19:33:32 on dist-test-slave-f0tn"
server_key: "e6f5488706adc99238a4897fa1a45d40"
server_key_iv: "b1fc26334168cb155b76e4ce85d1aea3"
server_key_version: "encryptionkey@0"
I20260806 19:33:32.845661 16001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 19:33:32.849642 16025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:32.851138 16001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:32.851315 16001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "1b22c0add0b749578a6b6fde378dc49c"
format_stamp: "Formatted at 2026-08-06 19:33:32 on dist-test-slave-f0tn"
server_key: "e6f5488706adc99238a4897fa1a45d40"
server_key_iv: "b1fc26334168cb155b76e4ce85d1aea3"
server_key_version: "encryptionkey@0"
I20260806 19:33:32.851516 16001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:32.857771 16001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:32.862229 16001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:32.862556 16001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:32.882470 16001 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44069
I20260806 19:33:32.882490 16091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44069 every 8 connection(s)
I20260806 19:33:32.884006 16001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:32.888198 16092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:32.890304 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16001
I20260806 19:33:32.890496 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:32.891083 17481 external_mini_cluster.cc:1428] Setting key ccdf62ad2c87e3b8128ea3558b8e776a
I20260806 19:33:32.899782 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:32.893194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44601 (local address 127.0.0.1:44069)
0806 19:33:32.894155 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:32.894167 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:32.894223 (+ 56us) server_negotiation.cc:407] Connection header received
0806 19:33:32.896021 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:32.896051 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:32.896482 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:32.896853 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:32.898079 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:32.898087 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:32.898102 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:32.898119 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:32.898191 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:32.898212 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:32.898402 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:32.898508 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 19:33:32.898709 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":459,"threads_started":1}
I20260806 19:33:32.903632 16092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c: Bootstrap starting.
I20260806 19:33:32.903918 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:32.907100 16092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:32.908288 16092 log.cc:824] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:32.911432 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:32.908506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40111 (local address 127.0.0.1:44069)
0806 19:33:32.908704 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:32.908710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:32.909525 (+ 815us) server_negotiation.cc:407] Connection header received
0806 19:33:32.909730 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:32.909735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:32.909795 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:32.909904 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:32.910808 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:32.910814 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:32.910819 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:32.910841 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:32.910889 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:32.910910 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:32.911036 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:32.911080 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 19:33:32.911143 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 19:33:32.911890 16092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c: No bootstrap required, opened a new log
I20260806 19:33:32.920436 16092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } }
I20260806 19:33:32.920902 16092 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:32.920985 16092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b22c0add0b749578a6b6fde378dc49c, State: Initialized, Role: FOLLOWER
I20260806 19:33:32.921614 16092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } }
I20260806 19:33:32.921896 16092 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:32.922014 16092 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:32.922155 16092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:32.924518 16092 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } }
I20260806 19:33:32.925127 16092 leader_election.cc:302] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b22c0add0b749578a6b6fde378dc49c; no voters:
I20260806 19:33:32.925995 16092 leader_election.cc:288] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:32.926137 16105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:32.927249 16105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [term 1 LEADER]: Becoming Leader. State: Replica: 1b22c0add0b749578a6b6fde378dc49c, State: Running, Role: LEADER
I20260806 19:33:32.927847 16105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } }
I20260806 19:33:32.928507 16092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:32.931620 16109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b22c0add0b749578a6b6fde378dc49c. Latest consensus state: current_term: 1 leader_uuid: "1b22c0add0b749578a6b6fde378dc49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } } }
I20260806 19:33:32.932058 16109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:32.933032 16108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b22c0add0b749578a6b6fde378dc49c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b22c0add0b749578a6b6fde378dc49c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44069 } } }
I20260806 19:33:32.933321 16108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:32.934384 16118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:32.941434 16118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:32.952659 16118 catalog_manager.cc:1347] Generated new cluster ID: 8a8b632345f94d55964000296c3dc06a
I20260806 19:33:32.952795 16118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:32.984243 16118 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:32.984736 16118 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:32.993970 16118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b22c0add0b749578a6b6fde378dc49c: Generated new TSK 0
I20260806 19:33:32.995018 16118 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:33.014093 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16001
W20260806 19:33:33.015347 16086 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44601
W20260806 19:33:33.016157 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16001: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:33.016309 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16001
2026-08-06T19:33:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2262 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:33 dist-test-slave-f0tn krb5kdc[16137](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:33 dist-test-slave-f0tn krb5kdc[16137](info): set up 2 sockets
Aug 06 19:33:33 dist-test-slave-f0tn krb5kdc[16137](info): commencing operation
krb5kdc: starting...
W20260806 19:33:34.282935 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.001s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:34 dist-test-slave-f0tn krb5kdc[16137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:34.661571 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43959
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:35.034137 16154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:35.034471 16154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:35.034601 16154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:35.042586 16154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:35.042752 16154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:35.042843 16154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:35.042938 16154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:35.043001 16154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:35.053610 16154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:35.055079 16154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:35.056591 16154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:35.069695 16160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:35.069636 16166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:35.069680 16161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:35.071024 16154 server_base.cc:1034] running on GCE node
I20260806 19:33:35.071964 16154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:35.073637 16154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:35.074882 16154 hybrid_clock.cc:648] HybridClock initialized: now 1786044815074814 us; error 65 us; skew 500 ppm
I20260806 19:33:35.075289 16154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:35 dist-test-slave-f0tn krb5kdc[16137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044815, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:35.078768 16154 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:35.080415 16154 webserver.cc:460] Webserver started at http://127.0.0.1:42247/ using document root <none> and password file <none>
I20260806 19:33:35.081151 16154 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:35.081269 16154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:35.081626 16154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:35.084973 16154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "f83668546f6c4aff8e521e789ea6e24c"
format_stamp: "Formatted at 2026-08-06 19:33:35 on dist-test-slave-f0tn"
server_key: "3d7a356d1153fdc2699329a366a07ff0"
server_key_iv: "e6a7a24a93853226d829dbf497c86e09"
server_key_version: "encryptionkey@0"
I20260806 19:33:35.085888 16154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "f83668546f6c4aff8e521e789ea6e24c"
format_stamp: "Formatted at 2026-08-06 19:33:35 on dist-test-slave-f0tn"
server_key: "3d7a356d1153fdc2699329a366a07ff0"
server_key_iv: "e6a7a24a93853226d829dbf497c86e09"
server_key_version: "encryptionkey@0"
I20260806 19:33:35.091914 16154 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:33:35.096081 16173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:35.097847 16154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:35.098052 16154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "f83668546f6c4aff8e521e789ea6e24c"
format_stamp: "Formatted at 2026-08-06 19:33:35 on dist-test-slave-f0tn"
server_key: "3d7a356d1153fdc2699329a366a07ff0"
server_key_iv: "e6a7a24a93853226d829dbf497c86e09"
server_key_version: "encryptionkey@0"
I20260806 19:33:35.098256 16154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:35.120705 16154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:35.125419 16154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:35.125701 16154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:35.144688 16154 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43959
I20260806 19:33:35.144742 16243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43959 every 8 connection(s)
I20260806 19:33:35.146308 16154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:35.149566 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16154
I20260806 19:33:35.149749 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:35.150225 17481 external_mini_cluster.cc:1428] Setting key 17501f473b79d7e843b903894c8a55da
I20260806 19:33:35.150687 16245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:35.166525 16245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c: Bootstrap starting.
Aug 06 19:33:35 dist-test-slave-f0tn krb5kdc[16137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 19:33:35.170892 16245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:35.172469 16245 log.cc:824] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:35.176628 16245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c: No bootstrap required, opened a new log
I20260806 19:33:35.179324 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:35.152380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:52511 (local address 127.0.0.1:43959)
0806 19:33:35.153409 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:35.153427 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:35.153499 (+ 72us) server_negotiation.cc:407] Connection header received
0806 19:33:35.156034 (+ 2535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:35.156085 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:35.156782 (+ 697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:35.157330 (+ 548us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:35.158922 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:35.160897 (+ 1975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:35.162473 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:35.163659 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:35.163891 (+ 232us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:35.168704 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:35.168718 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:35.168740 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:35.168798 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:35.173004 (+ 4206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:35.174468 (+ 1464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:35.174478 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:35.174489 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:35.174748 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:35.175539 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:35.175546 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:35.175549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:35.176360 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:35.176737 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:35.177255 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 19:33:35.177747 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":749,"thread_start_us":471,"threads_started":1}
I20260806 19:33:35.184502 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:35.186933 16245 raft_consensus.cc:348] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } }
I20260806 19:33:35.187458 16245 raft_consensus.cc:374] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:35.187602 16245 raft_consensus.cc:729] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f83668546f6c4aff8e521e789ea6e24c, State: Initialized, Role: FOLLOWER
I20260806 19:33:35.188364 16245 consensus_queue.cc:260] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } }
I20260806 19:33:35.188627 16245 raft_consensus.cc:388] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:35.188789 16245 raft_consensus.cc:482] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:35.189007 16245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:35.191776 16245 raft_consensus.cc:504] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } }
I20260806 19:33:35.192430 16245 leader_election.cc:302] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f83668546f6c4aff8e521e789ea6e24c; no voters:
I20260806 19:33:35.193147 16245 leader_election.cc:288] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:35.193257 16261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:35.196079 16245 sys_catalog.cc:564] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:35.200146 16261 raft_consensus.cc:686] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [term 1 LEADER]: Becoming Leader. State: Replica: f83668546f6c4aff8e521e789ea6e24c, State: Running, Role: LEADER
I20260806 19:33:35.201116 16261 consensus_queue.cc:237] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } }
I20260806 19:33:35.205003 16262 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f83668546f6c4aff8e521e789ea6e24c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } } }
I20260806 19:33:35.205466 16262 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:35.205613 16251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:35.189320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:45615 (local address 127.0.0.1:43959)
0806 19:33:35.189556 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:35.189563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:35.189928 (+ 365us) server_negotiation.cc:407] Connection header received
0806 19:33:35.190126 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:35.190132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:35.190221 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:35.190321 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:35.191890 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:35.192781 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:35.194419 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:35.194886 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:35.195016 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:35.197805 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:35.197810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:35.197814 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:35.197853 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:35.201053 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:35.202234 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:35.202241 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:35.202246 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:35.202439 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:35.203022 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:35.203027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:35.203031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:35.203464 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:35.203818 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:35.204850 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0806 19:33:35.205116 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 19:33:35.208618 16263 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f83668546f6c4aff8e521e789ea6e24c. Latest consensus state: current_term: 1 leader_uuid: "f83668546f6c4aff8e521e789ea6e24c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83668546f6c4aff8e521e789ea6e24c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43959 } } }
I20260806 19:33:35.209120 16263 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:35.210314 16272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:35.215915 16272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:35.225980 16272 catalog_manager.cc:1347] Generated new cluster ID: 4a0b2f247a1e41f89ce681c19a010dc5
I20260806 19:33:35.226128 16272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:35.262784 16272 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:35.264528 16272 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:35.272600 16272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f83668546f6c4aff8e521e789ea6e24c: Generated new TSK 0
I20260806 19:33:35.273641 16272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:35.286248 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16154
I20260806 19:33:35.287942 16235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:35.385772 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16154
W20260806 19:33:35.413642 16135 connection.cc:535] client connection to 127.0.0.1:43959 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43959): Connection reset by peer (error 104)
2026-08-06T19:33:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2368 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:35 dist-test-slave-f0tn krb5kdc[16290](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:35 dist-test-slave-f0tn krb5kdc[16290](info): set up 2 sockets
Aug 06 19:33:35 dist-test-slave-f0tn krb5kdc[16290](info): commencing operation
krb5kdc: starting...
W20260806 19:33:36.655966 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.010s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:36 dist-test-slave-f0tn krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:37.046936 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:37.441751 16310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:37.442073 16310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:37.442216 16310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:37.450133 16310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:37.450277 16310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:37.450353 16310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:37.450438 16310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:37.450497 16310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:37.460950 16310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:37.462462 16310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:37.463855 16310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:37.476202 16318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:37.476161 16319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:37.476236 16322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:37.477576 16310 server_base.cc:1034] running on GCE node
I20260806 19:33:37.478514 16310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:37.480218 16310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:37.481488 16310 hybrid_clock.cc:648] HybridClock initialized: now 1786044817481433 us; error 48 us; skew 500 ppm
I20260806 19:33:37.481921 16310 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:37 dist-test-slave-f0tn krb5kdc[16290](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044817, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:37.489634 16310 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:37.491508 16310 webserver.cc:460] Webserver started at http://127.0.0.1:44145/ using document root <none> and password file <none>
I20260806 19:33:37.492304 16310 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:37.492439 16310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:37.492781 16310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:37.496259 16310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "4decce11ec2144e69a6d000907d00592"
format_stamp: "Formatted at 2026-08-06 19:33:37 on dist-test-slave-f0tn"
server_key: "9550e339ff9fb3f951075553b614cd49"
server_key_iv: "72ee8d23f3fa2f29084b85054646c1bb"
server_key_version: "encryptionkey@0"
I20260806 19:33:37.497148 16310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "4decce11ec2144e69a6d000907d00592"
format_stamp: "Formatted at 2026-08-06 19:33:37 on dist-test-slave-f0tn"
server_key: "9550e339ff9fb3f951075553b614cd49"
server_key_iv: "72ee8d23f3fa2f29084b85054646c1bb"
server_key_version: "encryptionkey@0"
I20260806 19:33:37.503178 16310 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 19:33:37.507279 16329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:37.508816 16310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 19:33:37.508996 16310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "4decce11ec2144e69a6d000907d00592"
format_stamp: "Formatted at 2026-08-06 19:33:37 on dist-test-slave-f0tn"
server_key: "9550e339ff9fb3f951075553b614cd49"
server_key_iv: "72ee8d23f3fa2f29084b85054646c1bb"
server_key_version: "encryptionkey@0"
I20260806 19:33:37.509241 16310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:37.531225 16310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:37.535982 16310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:37.536288 16310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:37.558130 16310 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42467
I20260806 19:33:37.558171 16400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42467 every 8 connection(s)
I20260806 19:33:37.559691 16310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:37.564021 16401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:37.566692 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16310
I20260806 19:33:37.566886 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:37.567376 17481 external_mini_cluster.cc:1428] Setting key bf7ac913d5b599d37b2d7f799c3ee763
I20260806 19:33:37.578733 16401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592: Bootstrap starting.
I20260806 19:33:37.583153 16401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:37.584728 16401 log.cc:824] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:37.584822 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:37.569608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:33283 (local address 127.0.0.1:42467)
0806 19:33:37.570583 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:37.570600 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:37.570661 (+ 61us) server_negotiation.cc:407] Connection header received
0806 19:33:37.573019 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:37.573056 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:37.573678 (+ 622us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:37.574200 (+ 522us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:37.574835 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:37.576974 (+ 2139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:37.578860 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:37.579966 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:37.580175 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:37.581537 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:37.581548 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:37.581569 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:37.582381 (+ 812us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:37.582501 (+ 120us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:37.582539 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:37.582723 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:37.583115 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 19:33:37.583344 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":446,"threads_started":1}
I20260806 19:33:37.588315 16401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592: No bootstrap required, opened a new log
I20260806 19:33:37.589854 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:37.599048 16401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } }
I20260806 19:33:37.599515 16401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:37.599653 16401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4decce11ec2144e69a6d000907d00592, State: Initialized, Role: FOLLOWER
I20260806 19:33:37.600332 16401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } }
I20260806 19:33:37.600613 16401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:37.600780 16401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:37.600947 16401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:37.602900 16406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:37.595920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:55159 (local address 127.0.0.1:42467)
0806 19:33:37.596138 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:37.596144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:37.596455 (+ 311us) server_negotiation.cc:407] Connection header received
0806 19:33:37.596626 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:37.596631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:37.596733 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:37.596855 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:37.597362 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:37.598270 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:37.599723 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:37.600294 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:37.600420 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:37.602069 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:37.602075 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:37.602079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:37.602105 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:37.602157 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:37.602177 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:37.602304 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:37.602540 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 19:33:37.602609 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 19:33:37.603992 16401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } }
I20260806 19:33:37.604682 16401 leader_election.cc:302] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4decce11ec2144e69a6d000907d00592; no voters:
I20260806 19:33:37.605412 16401 leader_election.cc:288] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:37.605571 16415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:37.606769 16415 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [term 1 LEADER]: Becoming Leader. State: Replica: 4decce11ec2144e69a6d000907d00592, State: Running, Role: LEADER
I20260806 19:33:37.607493 16415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } }
I20260806 19:33:37.607944 16401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:37.610477 16417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4decce11ec2144e69a6d000907d00592. Latest consensus state: current_term: 1 leader_uuid: "4decce11ec2144e69a6d000907d00592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } } }
I20260806 19:33:37.610915 16417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:37.611037 16416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4decce11ec2144e69a6d000907d00592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4decce11ec2144e69a6d000907d00592" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42467 } } }
I20260806 19:33:37.611359 16416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:37.619608 16425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:37.626416 16425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:37.637310 16425 catalog_manager.cc:1347] Generated new cluster ID: f6a4c314a3da4a149b5f53a02a631f92
I20260806 19:33:37.637485 16425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:37.656589 16425 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:37.658685 16425 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:37.670593 16425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4decce11ec2144e69a6d000907d00592: Generated new TSK 0
I20260806 19:33:37.671492 16425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:37.677898 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16310
W20260806 19:33:37.679440 16392 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.119:33283
W20260806 19:33:37.680326 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16310: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:37.680501 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16310
W20260806 19:33:37.707983 16287 connection.cc:535] client connection to 127.0.0.1:42467 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42467): Connection reset by peer (error 104)
2026-08-06T19:33:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:37 dist-test-slave-f0tn krb5kdc[16442](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:37 dist-test-slave-f0tn krb5kdc[16442](info): set up 2 sockets
Aug 06 19:33:37 dist-test-slave-f0tn krb5kdc[16442](info): commencing operation
krb5kdc: starting...
W20260806 19:33:38.936728 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.009s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:39 dist-test-slave-f0tn krb5kdc[16442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:39.325276 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45737
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:39.707798 16461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:39.708140 16461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:39.708253 16461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:39.716498 16461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:39.716660 16461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:39.716717 16461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:39.716781 16461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:39.716827 16461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:39.728379 16461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:39.729833 16461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:39.731280 16461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:39.744755 16470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:39.744843 16467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:39.744850 16468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:39.745952 16461 server_base.cc:1034] running on GCE node
I20260806 19:33:39.746907 16461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:39.748592 16461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:39.749869 16461 hybrid_clock.cc:648] HybridClock initialized: now 1786044819749804 us; error 58 us; skew 500 ppm
I20260806 19:33:39.750331 16461 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:39 dist-test-slave-f0tn krb5kdc[16442](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044819, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:39.753968 16461 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:39.755848 16461 webserver.cc:460] Webserver started at http://127.0.0.1:38001/ using document root <none> and password file <none>
I20260806 19:33:39.756659 16461 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:39.756812 16461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:39.757330 16461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:39.761137 16461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "4bd256261236490c96415ffd6f6890a4"
format_stamp: "Formatted at 2026-08-06 19:33:39 on dist-test-slave-f0tn"
server_key: "217ca7aa542767d6e845496d1786ca5d"
server_key_iv: "8da76d455783c7779294c003b2f7b13c"
server_key_version: "encryptionkey@0"
I20260806 19:33:39.762190 16461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "4bd256261236490c96415ffd6f6890a4"
format_stamp: "Formatted at 2026-08-06 19:33:39 on dist-test-slave-f0tn"
server_key: "217ca7aa542767d6e845496d1786ca5d"
server_key_iv: "8da76d455783c7779294c003b2f7b13c"
server_key_version: "encryptionkey@0"
I20260806 19:33:39.768464 16461 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:33:39.772650 16482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:39.774290 16461 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:39.774509 16461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "4bd256261236490c96415ffd6f6890a4"
format_stamp: "Formatted at 2026-08-06 19:33:39 on dist-test-slave-f0tn"
server_key: "217ca7aa542767d6e845496d1786ca5d"
server_key_iv: "8da76d455783c7779294c003b2f7b13c"
server_key_version: "encryptionkey@0"
I20260806 19:33:39.774720 16461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:39.781701 16461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:39.786610 16461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:39.786948 16461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:39.805277 16461 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45737
I20260806 19:33:39.805323 16550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45737 every 8 connection(s)
I20260806 19:33:39.806939 16461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:39.811143 16551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:39.814162 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16461
I20260806 19:33:39.814348 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:39.814898 17481 external_mini_cluster.cc:1428] Setting key 0b568d807e0d4dfcc26f63473dace077
I20260806 19:33:39.824156 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:39.817173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:47061 (local address 127.0.0.1:45737)
0806 19:33:39.818194 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:39.818211 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:39.818262 (+ 51us) server_negotiation.cc:407] Connection header received
0806 19:33:39.820142 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:39.820174 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:39.820582 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:39.821041 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:39.822224 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:39.822230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:39.822246 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:39.822261 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:39.822319 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:39.822342 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:39.822545 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:39.822785 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 19:33:39.823031 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":425,"threads_started":1}
I20260806 19:33:39.825990 16551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4: Bootstrap starting.
I20260806 19:33:39.829069 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:39.830364 16551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:39.832039 16551 log.cc:824] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:39.836390 16551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4: No bootstrap required, opened a new log
I20260806 19:33:39.837811 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:39.835123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:46575 (local address 127.0.0.1:45737)
0806 19:33:39.835320 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:39.835327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:39.835762 (+ 435us) server_negotiation.cc:407] Connection header received
0806 19:33:39.835950 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:39.835955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:39.836007 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:39.836094 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:39.837115 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:39.837120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:39.837123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:39.837141 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:39.837186 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:39.837210 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:39.837322 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:39.837455 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 19:33:39.837530 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 19:33:39.845000 16551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } }
I20260806 19:33:39.845541 16551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:39.845649 16551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bd256261236490c96415ffd6f6890a4, State: Initialized, Role: FOLLOWER
I20260806 19:33:39.846305 16551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } }
I20260806 19:33:39.846560 16551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:39.846704 16551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:39.846879 16551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:39.849634 16551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } }
I20260806 19:33:39.850219 16551 leader_election.cc:302] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bd256261236490c96415ffd6f6890a4; no voters:
I20260806 19:33:39.850884 16551 leader_election.cc:288] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:39.851074 16564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:39.851804 16564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [term 1 LEADER]: Becoming Leader. State: Replica: 4bd256261236490c96415ffd6f6890a4, State: Running, Role: LEADER
I20260806 19:33:39.852375 16564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } }
I20260806 19:33:39.853024 16551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:39.855405 16565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bd256261236490c96415ffd6f6890a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } } }
I20260806 19:33:39.855911 16565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:39.857013 16568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bd256261236490c96415ffd6f6890a4. Latest consensus state: current_term: 1 leader_uuid: "4bd256261236490c96415ffd6f6890a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bd256261236490c96415ffd6f6890a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45737 } } }
I20260806 19:33:39.857460 16568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:39.858515 16576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:39.863628 16576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:39.874408 16576 catalog_manager.cc:1347] Generated new cluster ID: 5168c652beb44869820be97eb36d0937
I20260806 19:33:39.874558 16576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:39.893316 16576 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:39.893873 16576 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:39.912671 16576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bd256261236490c96415ffd6f6890a4: Generated new TSK 0
I20260806 19:33:39.913723 16576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:39.920768 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16461
W20260806 19:33:39.921981 16545 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.119:47061
W20260806 19:33:39.922689 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16461: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:39.922829 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16461
2026-08-06T19:33:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2241 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:40 dist-test-slave-f0tn krb5kdc[16592](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:40 dist-test-slave-f0tn krb5kdc[16592](info): set up 2 sockets
Aug 06 19:33:40 dist-test-slave-f0tn krb5kdc[16592](info): commencing operation
krb5kdc: starting...
W20260806 19:33:41.203008 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.001s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:41 dist-test-slave-f0tn krb5kdc[16592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:41.583017 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40863
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:41.965994 16612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:41.966346 16612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:41.966485 16612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:41.973886 16612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:41.974005 16612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:41.974078 16612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:41.974164 16612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:41.974228 16612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:41.984505 16612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40863
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:41.985972 16612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:41.987344 16612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:41.999732 16621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:41.999974 16617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:41.999758 16618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:42.000792 16612 server_base.cc:1034] running on GCE node
I20260806 19:33:42.001674 16612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:42.003288 16612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:42.004560 16612 hybrid_clock.cc:648] HybridClock initialized: now 1786044822004501 us; error 36 us; skew 500 ppm
I20260806 19:33:42.004943 16612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:42 dist-test-slave-f0tn krb5kdc[16592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044822, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:42.013098 16612 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:42.014948 16612 webserver.cc:460] Webserver started at http://127.0.0.1:41001/ using document root <none> and password file <none>
I20260806 19:33:42.015700 16612 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:42.015818 16612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:42.016101 16612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:42.019502 16612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "3879698a14494e7f8acc65d5696fad63"
format_stamp: "Formatted at 2026-08-06 19:33:42 on dist-test-slave-f0tn"
server_key: "79824b04c17c3305896c7edf66bbc35a"
server_key_iv: "c09a8ef2eb9e36e2ada9ac9963c3c292"
server_key_version: "encryptionkey@0"
I20260806 19:33:42.020349 16612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "3879698a14494e7f8acc65d5696fad63"
format_stamp: "Formatted at 2026-08-06 19:33:42 on dist-test-slave-f0tn"
server_key: "79824b04c17c3305896c7edf66bbc35a"
server_key_iv: "c09a8ef2eb9e36e2ada9ac9963c3c292"
server_key_version: "encryptionkey@0"
I20260806 19:33:42.026059 16612 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 19:33:42.029975 16633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:42.031562 16612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:42.031765 16612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "3879698a14494e7f8acc65d5696fad63"
format_stamp: "Formatted at 2026-08-06 19:33:42 on dist-test-slave-f0tn"
server_key: "79824b04c17c3305896c7edf66bbc35a"
server_key_iv: "c09a8ef2eb9e36e2ada9ac9963c3c292"
server_key_version: "encryptionkey@0"
I20260806 19:33:42.031971 16612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:42.074651 16612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:42.080969 16612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:42.081347 16612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:42.102761 16612 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40863
I20260806 19:33:42.102789 16709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40863 every 8 connection(s)
I20260806 19:33:42.104319 16612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:42.108595 16710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:42.113143 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16612
I20260806 19:33:42.113322 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:42.113829 17481 external_mini_cluster.cc:1428] Setting key 53a8612eeb56192fa34654f54c91e970
I20260806 19:33:42.120651 16710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63: Bootstrap starting.
I20260806 19:33:42.124136 16710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:42.125296 16710 log.cc:824] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:42.128589 16710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63: No bootstrap required, opened a new log
Aug 06 19:33:42 dist-test-slave-f0tn krb5kdc[16592](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 19:33:42.137234 16710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 19:33:42.137761 16710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:42.137876 16710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3879698a14494e7f8acc65d5696fad63, State: Initialized, Role: FOLLOWER
I20260806 19:33:42.138543 16710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 19:33:42.138798 16710 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:42.138955 16710 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:42.139075 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:42.115975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:53087 (local address 127.0.0.1:40863)
0806 19:33:42.116935 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:42.116949 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:42.117003 (+ 54us) server_negotiation.cc:407] Connection header received
0806 19:33:42.119213 (+ 2210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:42.119246 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:42.119732 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:42.120162 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:42.121930 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:42.123320 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:42.124704 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:42.125509 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:42.125701 (+ 192us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:42.130319 (+ 4618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:42.130334 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:42.130355 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:42.130408 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:42.133888 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:42.134918 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:42.134930 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:42.134938 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:42.135172 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:42.135705 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:42.135709 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:42.135711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:42.136373 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:42.136700 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:42.137335 (+ 635us) server_negotiation.cc:299] Negotiation successful
0806 19:33:42.137764 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":449,"threads_started":1}
I20260806 19:33:42.139179 16710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:42.142095 16710 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 19:33:42.142721 16710 leader_election.cc:302] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3879698a14494e7f8acc65d5696fad63; no voters:
I20260806 19:33:42.143400 16710 leader_election.cc:288] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:42.143484 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:42.143525 16717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:42.145991 16710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:42.150650 16717 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [term 1 LEADER]: Becoming Leader. State: Replica: 3879698a14494e7f8acc65d5696fad63, State: Running, Role: LEADER
I20260806 19:33:42.151612 16717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } }
I20260806 19:33:42.155159 16718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3879698a14494e7f8acc65d5696fad63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } } }
I20260806 19:33:42.155618 16718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:42.159925 16720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3879698a14494e7f8acc65d5696fad63. Latest consensus state: current_term: 1 leader_uuid: "3879698a14494e7f8acc65d5696fad63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3879698a14494e7f8acc65d5696fad63" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40863 } } }
I20260806 19:33:42.160324 16720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:42.169144 16741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:42.169937 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:42.148960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:37159 (local address 127.0.0.1:40863)
0806 19:33:42.149148 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:42.149154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:42.149173 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:33:42.149234 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:42.149237 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:42.149301 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:42.149417 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:42.151435 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:42.152562 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:42.154263 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:42.155084 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:42.155204 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:42.160761 (+ 5557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:42.160770 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:42.160777 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:42.160835 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:42.165228 (+ 4393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:42.166692 (+ 1464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:42.166699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:42.166704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:42.166901 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:42.167582 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:42.167588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:42.167592 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:42.168087 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:42.168393 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:42.169215 (+ 822us) server_negotiation.cc:299] Negotiation successful
0806 19:33:42.169500 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:33:42.177224 16741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:42.188553 16741 catalog_manager.cc:1347] Generated new cluster ID: 3067697814264b0ba715e526d4934a1f
I20260806 19:33:42.188707 16741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:42.208112 16741 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:42.209786 16741 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:42.224341 16741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3879698a14494e7f8acc65d5696fad63: Generated new TSK 0
I20260806 19:33:42.225533 16741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:42.241031 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16612
I20260806 19:33:42.243218 16704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:42.339474 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16612
W20260806 19:33:42.367194 16590 connection.cc:535] client connection to 127.0.0.1:40863 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40863): Connection reset by peer (error 104)
2026-08-06T19:33:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2422 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:42 dist-test-slave-f0tn krb5kdc[16759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:42 dist-test-slave-f0tn krb5kdc[16759](info): set up 2 sockets
Aug 06 19:33:42 dist-test-slave-f0tn krb5kdc[16759](info): commencing operation
krb5kdc: starting...
W20260806 19:33:43.598035 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.005s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:43 dist-test-slave-f0tn krb5kdc[16759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:43.977703 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36001
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:44.359266 16775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:44.359622 16775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:44.359763 16775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:44.368007 16775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:44.368162 16775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:44.368227 16775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:44.368327 16775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:44.368391 16775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:44.379463 16775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36001
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:44.381013 16775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:44.382565 16775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:44.395983 16782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:44.395933 16785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:44.396368 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:44.396938 16775 server_base.cc:1034] running on GCE node
I20260806 19:33:44.397903 16775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:44.399515 16775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:44.400761 16775 hybrid_clock.cc:648] HybridClock initialized: now 1786044824400711 us; error 43 us; skew 500 ppm
I20260806 19:33:44.401158 16775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:44 dist-test-slave-f0tn krb5kdc[16759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044824, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:44.408921 16775 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:44.410898 16775 webserver.cc:460] Webserver started at http://127.0.0.1:45481/ using document root <none> and password file <none>
I20260806 19:33:44.411701 16775 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:44.411844 16775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:44.412191 16775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:44.415616 16775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9"
format_stamp: "Formatted at 2026-08-06 19:33:44 on dist-test-slave-f0tn"
server_key: "1a7a055cd81c2503b1d23f793b8b97ba"
server_key_iv: "7fff1a5e8fb64228980712e5ef2f3456"
server_key_version: "encryptionkey@0"
I20260806 19:33:44.416468 16775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9"
format_stamp: "Formatted at 2026-08-06 19:33:44 on dist-test-slave-f0tn"
server_key: "1a7a055cd81c2503b1d23f793b8b97ba"
server_key_iv: "7fff1a5e8fb64228980712e5ef2f3456"
server_key_version: "encryptionkey@0"
I20260806 19:33:44.422369 16775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 19:33:44.426380 16802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:44.427873 16775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:44.428083 16775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9"
format_stamp: "Formatted at 2026-08-06 19:33:44 on dist-test-slave-f0tn"
server_key: "1a7a055cd81c2503b1d23f793b8b97ba"
server_key_iv: "7fff1a5e8fb64228980712e5ef2f3456"
server_key_version: "encryptionkey@0"
I20260806 19:33:44.428292 16775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:44.447568 16775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:44.452075 16775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:44.452364 16775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:44.471167 16775 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36001
I20260806 19:33:44.471194 16874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36001 every 8 connection(s)
I20260806 19:33:44.472672 16775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:44.475653 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16775
I20260806 19:33:44.475857 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:44.476405 17481 external_mini_cluster.cc:1428] Setting key 30502f76f2360f299bf8155311a1bd90
I20260806 19:33:44.477741 16875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:44.493672 16878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:44.478661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:43087 (local address 127.0.0.1:36001)
0806 19:33:44.479564 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:44.479582 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:44.479640 (+ 58us) server_negotiation.cc:407] Connection header received
0806 19:33:44.481788 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:44.481824 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:44.482521 (+ 697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:44.483059 (+ 538us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:44.483666 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:44.485882 (+ 2216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:44.487441 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:44.488572 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:44.488789 (+ 217us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:44.490268 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:44.490281 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:44.490306 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:44.491198 (+ 892us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:44.491316 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:44.491362 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:44.491587 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:44.491925 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 19:33:44.492149 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":369,"threads_started":1}
I20260806 19:33:44.494736 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9: Bootstrap starting.
I20260806 19:33:44.498370 16875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:44.498417 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:44.499809 16875 log.cc:824] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:44.503798 16875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9: No bootstrap required, opened a new log
I20260806 19:33:44.511125 16878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:44.503854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:45879 (local address 127.0.0.1:36001)
0806 19:33:44.504104 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:44.504111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:44.504488 (+ 377us) server_negotiation.cc:407] Connection header received
0806 19:33:44.504674 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:44.504680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:44.504783 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:44.504900 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:44.505511 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:44.506728 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:44.508140 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:44.508856 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:44.509002 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:44.510265 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:44.510275 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:44.510280 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:44.510311 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:44.510366 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:44.510388 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:44.510507 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:44.510701 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 19:33:44.510772 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260806 19:33:44.515069 16875 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260806 19:33:44.515702 16875 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:44.515821 16875 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5aa6fb148d447e96f8e3b6d397e3c9, State: Initialized, Role: FOLLOWER
I20260806 19:33:44.516654 16875 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260806 19:33:44.517032 16875 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:44.517242 16875 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:44.517473 16875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:44.520887 16875 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260806 19:33:44.521631 16875 leader_election.cc:302] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec5aa6fb148d447e96f8e3b6d397e3c9; no voters:
I20260806 19:33:44.522349 16875 leader_election.cc:288] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:44.522495 16887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:44.523222 16887 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [term 1 LEADER]: Becoming Leader. State: Replica: ec5aa6fb148d447e96f8e3b6d397e3c9, State: Running, Role: LEADER
I20260806 19:33:44.523821 16887 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } }
I20260806 19:33:44.524703 16875 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:44.527236 16889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec5aa6fb148d447e96f8e3b6d397e3c9. Latest consensus state: current_term: 1 leader_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } } }
I20260806 19:33:44.527726 16889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:44.532191 16888 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec5aa6fb148d447e96f8e3b6d397e3c9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36001 } } }
I20260806 19:33:44.532583 16897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:44.532596 16888 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:44.538841 16897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:44.548543 16897 catalog_manager.cc:1347] Generated new cluster ID: 78ff05d990504577bdea65ef755d6206
I20260806 19:33:44.548691 16897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:44.565124 16897 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:44.566623 16897 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:44.573446 16897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec5aa6fb148d447e96f8e3b6d397e3c9: Generated new TSK 0
I20260806 19:33:44.574715 16897 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:44.583485 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16775
W20260806 19:33:44.585139 16869 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.119:43087
W20260806 19:33:44.586136 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16775: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:44.586300 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16775
W20260806 19:33:44.608428 16757 connection.cc:535] client connection to 127.0.0.1:36001 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36001): Connection reset by peer (error 104)
2026-08-06T19:33:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2236 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:44 dist-test-slave-f0tn krb5kdc[16917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:44 dist-test-slave-f0tn krb5kdc[16917](info): set up 2 sockets
Aug 06 19:33:44 dist-test-slave-f0tn krb5kdc[16917](info): commencing operation
krb5kdc: starting...
W20260806 19:33:45.834923 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.002s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:46 dist-test-slave-f0tn krb5kdc[16917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 19:33:46.218426 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38199
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:46.602752 16938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:46.603123 16938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:46.603226 16938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:46.611008 16938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:46.611155 16938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:46.611205 16938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:46.611269 16938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:46.611315 16938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:46.621799 16938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38199
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:46.623234 16938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:46.624667 16938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:46.638059 16944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:46.638192 16946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:46.638187 16948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:46.639358 16938 server_base.cc:1034] running on GCE node
I20260806 19:33:46.640298 16938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:46.642004 16938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:46.643253 16938 hybrid_clock.cc:648] HybridClock initialized: now 1786044826643193 us; error 47 us; skew 500 ppm
I20260806 19:33:46.643652 16938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:46 dist-test-slave-f0tn krb5kdc[16917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044826, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:46.647002 16938 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 19:33:46.649019 16938 webserver.cc:460] Webserver started at http://127.0.0.1:46665/ using document root <none> and password file <none>
I20260806 19:33:46.650094 16938 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:46.650276 16938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:46.650717 16938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:46.654042 16938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "00b601b3400f4ba28c4e9739b67e04be"
format_stamp: "Formatted at 2026-08-06 19:33:46 on dist-test-slave-f0tn"
server_key: "130caf467881721e9eed7ddb431fd128"
server_key_iv: "541e6ff2eca2b02723f7400e1ffa84c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:46.654882 16938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "00b601b3400f4ba28c4e9739b67e04be"
format_stamp: "Formatted at 2026-08-06 19:33:46 on dist-test-slave-f0tn"
server_key: "130caf467881721e9eed7ddb431fd128"
server_key_iv: "541e6ff2eca2b02723f7400e1ffa84c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:46.660681 16938 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:33:46.664795 16956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:46.666447 16938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:46.666657 16938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "00b601b3400f4ba28c4e9739b67e04be"
format_stamp: "Formatted at 2026-08-06 19:33:46 on dist-test-slave-f0tn"
server_key: "130caf467881721e9eed7ddb431fd128"
server_key_iv: "541e6ff2eca2b02723f7400e1ffa84c3"
server_key_version: "encryptionkey@0"
I20260806 19:33:46.666872 16938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:46.673225 16938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:46.677728 16938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:46.678052 16938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:46.698678 16938 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38199
I20260806 19:33:46.698716 17029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38199 every 8 connection(s)
I20260806 19:33:46.700232 16938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:46.704520 17030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:46.709347 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 16938
I20260806 19:33:46.709597 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:46.710060 17481 external_mini_cluster.cc:1428] Setting key 3926856c52ab5834b4c757f16935fb02
I20260806 19:33:46.716872 17030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be: Bootstrap starting.
I20260806 19:33:46.718945 17033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:46.712191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:39155 (local address 127.0.0.1:38199)
0806 19:33:46.713019 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:46.713031 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:46.713078 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:33:46.715060 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:46.715090 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:46.715475 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:46.715862 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:46.717196 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:46.717203 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:46.717219 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:46.717238 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:46.717312 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:46.717335 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:46.717615 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:46.717726 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 19:33:46.717941 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":334,"threads_started":1}
I20260806 19:33:46.720682 17030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:46.722038 17030 log.cc:824] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:46.722901 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:46.725299 17030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be: No bootstrap required, opened a new log
I20260806 19:33:46.730719 17033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:46.727656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.119:46727 (local address 127.0.0.1:38199)
0806 19:33:46.727868 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:46.727875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:46.728497 (+ 622us) server_negotiation.cc:407] Connection header received
0806 19:33:46.728716 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:46.728720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:46.728778 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:46.728876 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:46.730029 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:46.730033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:46.730037 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:46.730057 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:46.730108 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:46.730124 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:46.730231 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:46.730345 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 19:33:46.730400 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 19:33:46.735734 17030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } }
I20260806 19:33:46.736192 17030 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:46.736305 17030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00b601b3400f4ba28c4e9739b67e04be, State: Initialized, Role: FOLLOWER
I20260806 19:33:46.736936 17030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } }
I20260806 19:33:46.737221 17030 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:46.737363 17030 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:46.737589 17030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:46.740480 17030 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } }
I20260806 19:33:46.741106 17030 leader_election.cc:302] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00b601b3400f4ba28c4e9739b67e04be; no voters:
I20260806 19:33:46.741822 17030 leader_election.cc:288] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:46.741958 17041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:46.742722 17041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [term 1 LEADER]: Becoming Leader. State: Replica: 00b601b3400f4ba28c4e9739b67e04be, State: Running, Role: LEADER
I20260806 19:33:46.743345 17041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } }
I20260806 19:33:46.744189 17030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:46.746526 17043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00b601b3400f4ba28c4e9739b67e04be. Latest consensus state: current_term: 1 leader_uuid: "00b601b3400f4ba28c4e9739b67e04be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } } }
I20260806 19:33:46.746554 17042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00b601b3400f4ba28c4e9739b67e04be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00b601b3400f4ba28c4e9739b67e04be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38199 } } }
I20260806 19:33:46.747099 17043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:46.747100 17042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:46.749644 17053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:46.754563 17053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:46.764400 17053 catalog_manager.cc:1347] Generated new cluster ID: 291c81b3baa14306b257f22f31ab6951
I20260806 19:33:46.764539 17053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:46.800515 17053 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:46.801252 17053 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:46.814544 17053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00b601b3400f4ba28c4e9739b67e04be: Generated new TSK 0
I20260806 19:33:46.815945 17053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:46.827464 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16938
W20260806 19:33:46.829066 17024 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.119:39155
W20260806 19:33:46.829893 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 16938: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:46.830037 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 16938
2026-08-06T19:33:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2252 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:46 dist-test-slave-f0tn krb5kdc[17071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:46 dist-test-slave-f0tn krb5kdc[17071](info): set up 2 sockets
Aug 06 19:33:46 dist-test-slave-f0tn krb5kdc[17071](info): commencing operation
krb5kdc: starting...
W20260806 19:33:48.090373 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.002s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:48 dist-test-slave-f0tn krb5kdc[17071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:48.478940 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45005
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:38665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:45005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:48.854125 17090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:48.854458 17090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:48.854585 17090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:48.862282 17090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:48.862425 17090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:48.862485 17090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:48.862576 17090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:48.862636 17090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:48.873361 17090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:38665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:45005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:45005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:48.874934 17090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:48.876415 17090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:48.889465 17097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:48.889514 17095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:48.889458 17099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:48.890988 17090 server_base.cc:1034] running on GCE node
I20260806 19:33:48.891959 17090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:48.893643 17090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:48.894940 17090 hybrid_clock.cc:648] HybridClock initialized: now 1786044828894886 us; error 49 us; skew 500 ppm
I20260806 19:33:48.895395 17090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:48 dist-test-slave-f0tn krb5kdc[17071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044828, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:48.898996 17090 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:48.900779 17090 webserver.cc:460] Webserver started at http://127.17.18.126:41185/ using document root <none> and password file <none>
I20260806 19:33:48.901571 17090 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:48.901698 17090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:48.902004 17090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:48.905300 17090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "f474455129284ba2b442afa5d364aae3"
format_stamp: "Formatted at 2026-08-06 19:33:48 on dist-test-slave-f0tn"
server_key: "988f84831ce383f1cddb3f4a28327c34"
server_key_iv: "ffac605fe9478087e6fa199c633b6e53"
server_key_version: "encryptionkey@0"
I20260806 19:33:48.906204 17090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "f474455129284ba2b442afa5d364aae3"
format_stamp: "Formatted at 2026-08-06 19:33:48 on dist-test-slave-f0tn"
server_key: "988f84831ce383f1cddb3f4a28327c34"
server_key_iv: "ffac605fe9478087e6fa199c633b6e53"
server_key_version: "encryptionkey@0"
I20260806 19:33:48.912309 17090 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:33:48.916805 17108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:48.918447 17090 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:33:48.918637 17090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "f474455129284ba2b442afa5d364aae3"
format_stamp: "Formatted at 2026-08-06 19:33:48 on dist-test-slave-f0tn"
server_key: "988f84831ce383f1cddb3f4a28327c34"
server_key_iv: "ffac605fe9478087e6fa199c633b6e53"
server_key_version: "encryptionkey@0"
I20260806 19:33:48.918838 17090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:48.941087 17090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:48.945828 17090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:48.946112 17090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:48.966459 17090 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:45005
I20260806 19:33:48.966490 17177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:45005 every 8 connection(s)
I20260806 19:33:48.967993 17090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:48.972409 17178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:48.976630 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17090
I20260806 19:33:48.976814 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:48.977254 17481 external_mini_cluster.cc:1428] Setting key b2a5aea936c9a9dbe7f115600218561e
I20260806 19:33:48.986374 17178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3: Bootstrap starting.
I20260806 19:33:48.990586 17178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:48.992036 17178 log.cc:824] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3: Log is configured to *not* fsync() on all Append() calls
Aug 06 19:33:48 dist-test-slave-f0tn krb5kdc[17071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:48.995859 17178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3: No bootstrap required, opened a new log
I20260806 19:33:49.003727 17184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:48.979151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42821 (local address 127.17.18.126:45005)
0806 19:33:48.980041 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:48.980053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:48.980097 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:33:48.981930 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:48.981959 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:48.982437 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:48.982823 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:48.984748 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:48.986208 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:48.988030 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:48.988756 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:48.988904 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:48.994184 (+ 5280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:48.994195 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:48.994218 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:48.994271 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:48.998458 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:48.999425 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:48.999436 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:48.999446 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:48.999685 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:49.000133 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:49.000139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:49.000142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:49.000914 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:49.001263 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:49.001771 (+ 508us) server_negotiation.cc:299] Negotiation successful
0806 19:33:49.002161 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":397,"threads_started":1}
I20260806 19:33:49.006637 17178 raft_consensus.cc:348] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } }
I20260806 19:33:49.007085 17178 raft_consensus.cc:374] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:49.007211 17178 raft_consensus.cc:729] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f474455129284ba2b442afa5d364aae3, State: Initialized, Role: FOLLOWER
I20260806 19:33:49.007872 17178 consensus_queue.cc:260] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } }
I20260806 19:33:49.008184 17178 raft_consensus.cc:388] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:49.008332 17178 raft_consensus.cc:482] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:49.008474 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:49.008526 17178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:49.010913 17178 raft_consensus.cc:504] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } }
I20260806 19:33:49.011507 17178 leader_election.cc:302] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f474455129284ba2b442afa5d364aae3; no voters:
I20260806 19:33:49.012236 17178 leader_election.cc:288] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:49.012326 17192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:49.013589 17192 raft_consensus.cc:686] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [term 1 LEADER]: Becoming Leader. State: Replica: f474455129284ba2b442afa5d364aae3, State: Running, Role: LEADER
I20260806 19:33:49.014232 17192 consensus_queue.cc:237] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } }
I20260806 19:33:49.014765 17178 sys_catalog.cc:564] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:49.017280 17196 sys_catalog.cc:455] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f474455129284ba2b442afa5d364aae3. Latest consensus state: current_term: 1 leader_uuid: "f474455129284ba2b442afa5d364aae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } } }
I20260806 19:33:49.017335 17194 sys_catalog.cc:455] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f474455129284ba2b442afa5d364aae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f474455129284ba2b442afa5d364aae3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 45005 } } }
I20260806 19:33:49.017810 17194 sys_catalog.cc:458] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:49.017808 17196 sys_catalog.cc:458] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:49.021811 17200 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:49.028898 17200 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:49.044030 17184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:49.013037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60035 (local address 127.17.18.126:45005)
0806 19:33:49.013213 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:49.013219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:49.025087 (+ 11868us) server_negotiation.cc:407] Connection header received
0806 19:33:49.025644 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:49.025650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:49.025735 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:49.025808 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:49.028099 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:49.029520 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:49.030784 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:49.031614 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:49.031761 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:49.035534 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:49.035542 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:49.035546 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:49.035591 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:49.039635 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:49.040878 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:49.040886 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:49.040890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:49.041078 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:49.041759 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:49.041765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:49.041769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:49.042272 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:49.042563 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:49.043374 (+ 811us) server_negotiation.cc:299] Negotiation successful
0806 19:33:49.043609 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 19:33:49.048038 17200 catalog_manager.cc:1347] Generated new cluster ID: c9420581cc594b53b04af585ae0ddf48
I20260806 19:33:49.048166 17200 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:49.069860 17200 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:49.071398 17200 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:49.078188 17200 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f474455129284ba2b442afa5d364aae3: Generated new TSK 0
I20260806 19:33:49.079133 17200 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:49.091249 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17090
I20260806 19:33:49.092512 17172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:49.186923 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17090
W20260806 19:33:49.215145 17069 connection.cc:535] client connection to 127.17.18.126:45005 recv error: Network error: failed to read from TLS socket (remote: 127.17.18.126:45005): Connection reset by peer (error 104)
2026-08-06T19:33:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2354 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:49 dist-test-slave-f0tn krb5kdc[17223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:49 dist-test-slave-f0tn krb5kdc[17223](info): set up 2 sockets
Aug 06 19:33:49 dist-test-slave-f0tn krb5kdc[17223](info): commencing operation
krb5kdc: starting...
W20260806 19:33:50.461649 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.002s sys 0.061s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:50 dist-test-slave-f0tn krb5kdc[17223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:50.837803 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36761
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:36761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:51.216871 17242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:51.217233 17242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:51.217409 17242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:51.225028 17242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:51.225189 17242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:51.225275 17242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:51.225363 17242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:51.225445 17242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:51.237089 17242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:36761
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:36761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:51.238711 17242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:51.240270 17242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:51.253796 17250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:51.253970 17254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:51.253815 17251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:51.254617 17242 server_base.cc:1034] running on GCE node
I20260806 19:33:51.255486 17242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:51.257066 17242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:51.258311 17242 hybrid_clock.cc:648] HybridClock initialized: now 1786044831258265 us; error 35 us; skew 500 ppm
I20260806 19:33:51.258689 17242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:51 dist-test-slave-f0tn krb5kdc[17223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044831, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:51.266775 17242 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:51.268558 17242 webserver.cc:460] Webserver started at http://127.17.18.126:37429/ using document root <none> and password file <none>
I20260806 19:33:51.269330 17242 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:51.269541 17242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:51.269891 17242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:51.273097 17242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f"
format_stamp: "Formatted at 2026-08-06 19:33:51 on dist-test-slave-f0tn"
server_key: "c16cf471d6e1b6232667d83a1002f9c2"
server_key_iv: "63b7f091aad638aab302f4d4c20969f8"
server_key_version: "encryptionkey@0"
I20260806 19:33:51.273968 17242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f"
format_stamp: "Formatted at 2026-08-06 19:33:51 on dist-test-slave-f0tn"
server_key: "c16cf471d6e1b6232667d83a1002f9c2"
server_key_iv: "63b7f091aad638aab302f4d4c20969f8"
server_key_version: "encryptionkey@0"
I20260806 19:33:51.279446 17242 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 19:33:51.283284 17263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:51.284759 17242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 19:33:51.284951 17242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f"
format_stamp: "Formatted at 2026-08-06 19:33:51 on dist-test-slave-f0tn"
server_key: "c16cf471d6e1b6232667d83a1002f9c2"
server_key_iv: "63b7f091aad638aab302f4d4c20969f8"
server_key_version: "encryptionkey@0"
I20260806 19:33:51.285183 17242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:51.304982 17242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:51.309684 17242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:51.309973 17242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:51.330331 17242 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:36761
I20260806 19:33:51.330343 17343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:36761 every 8 connection(s)
I20260806 19:33:51.331892 17242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:51.336360 17344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:51.336411 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17242
I20260806 19:33:51.336592 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:51.337045 17481 external_mini_cluster.cc:1428] Setting key eb46de5bfccb9c090c4df2103a28d3e8
I20260806 19:33:51.352244 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f: Bootstrap starting.
I20260806 19:33:51.352672 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:51.339053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35665 (local address 127.17.18.126:36761)
0806 19:33:51.340027 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:51.340040 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:51.340090 (+ 50us) server_negotiation.cc:407] Connection header received
0806 19:33:51.341987 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:51.342016 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:51.342496 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:51.342915 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:51.343703 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:51.345171 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:51.347153 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:51.347991 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:51.348169 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:51.349945 (+ 1776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:51.349954 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:51.349973 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:51.350608 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:51.350717 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:51.350749 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:51.350896 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:51.351309 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 19:33:51.351531 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":399,"threads_started":1}
I20260806 19:33:51.357218 17344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:51.358484 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:51.358749 17344 log.cc:824] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:51.362576 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f: No bootstrap required, opened a new log
I20260806 19:33:51.369791 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:51.363203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42797 (local address 127.17.18.126:36761)
0806 19:33:51.363382 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:51.363389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:51.363832 (+ 443us) server_negotiation.cc:407] Connection header received
0806 19:33:51.364030 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:51.364034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:51.364105 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:51.364195 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:51.364752 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:51.365689 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:51.367061 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:51.367593 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:51.367727 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:51.368937 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:51.368942 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:51.368946 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:51.368970 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:51.369016 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:51.369035 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:51.369161 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:51.369407 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 19:33:51.369473 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 19:33:51.371469 17344 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } }
I20260806 19:33:51.371905 17344 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:51.372006 17344 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c41839ca8f4b4cb4e0b9cd2cdd060f, State: Initialized, Role: FOLLOWER
I20260806 19:33:51.372639 17344 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } }
I20260806 19:33:51.372893 17344 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:51.373035 17344 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:51.373198 17344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:51.375609 17344 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } }
I20260806 19:33:51.376169 17344 leader_election.cc:302] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6c41839ca8f4b4cb4e0b9cd2cdd060f; no voters:
I20260806 19:33:51.376879 17344 leader_election.cc:288] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:51.377013 17356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:51.377707 17356 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [term 1 LEADER]: Becoming Leader. State: Replica: e6c41839ca8f4b4cb4e0b9cd2cdd060f, State: Running, Role: LEADER
I20260806 19:33:51.378399 17356 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } }
I20260806 19:33:51.379704 17344 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:51.381845 17357 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } } }
I20260806 19:33:51.382373 17357 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:51.381898 17358 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6c41839ca8f4b4cb4e0b9cd2cdd060f. Latest consensus state: current_term: 1 leader_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c41839ca8f4b4cb4e0b9cd2cdd060f" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 36761 } } }
I20260806 19:33:51.382682 17358 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:51.385958 17366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:51.391842 17366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:51.401315 17366 catalog_manager.cc:1347] Generated new cluster ID: a2a2e2b0186a4c6c9b409370a45b62f0
I20260806 19:33:51.401492 17366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:51.422372 17366 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:51.424034 17366 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:51.443804 17366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6c41839ca8f4b4cb4e0b9cd2cdd060f: Generated new TSK 0
I20260806 19:33:51.444934 17366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:51.464143 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17242
W20260806 19:33:51.465585 17337 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35665
W20260806 19:33:51.466430 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17242: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:51.466578 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17242
W20260806 19:33:51.492455 17221 connection.cc:535] client connection to 127.17.18.126:36761 recv error: Network error: failed to read from TLS socket (remote: 127.17.18.126:36761): Connection reset by peer (error 104)
2026-08-06T19:33:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2277 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:51 dist-test-slave-f0tn krb5kdc[17388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:51 dist-test-slave-f0tn krb5kdc[17388](info): set up 2 sockets
Aug 06 19:33:51 dist-test-slave-f0tn krb5kdc[17388](info): commencing operation
krb5kdc: starting...
W20260806 19:33:52.744854 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.003s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:52 dist-test-slave-f0tn krb5kdc[17388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:53.132676 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37869
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:45167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:53.510492 17405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:53.510860 17405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:53.511001 17405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:53.518738 17405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:53.518898 17405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:53.518980 17405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:53.519069 17405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:53.519127 17405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:53.529850 17405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:45167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37869
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:53.531312 17405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:53.532794 17405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:53.545457 17415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:53.545486 17420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:53.545457 17417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:53.546440 17405 server_base.cc:1034] running on GCE node
I20260806 19:33:53.547281 17405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:53.548736 17405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:53.549939 17405 hybrid_clock.cc:648] HybridClock initialized: now 1786044833549887 us; error 41 us; skew 500 ppm
I20260806 19:33:53.550325 17405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:53 dist-test-slave-f0tn krb5kdc[17388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044833, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:53.553774 17405 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:53.555440 17405 webserver.cc:460] Webserver started at http://127.17.18.126:38897/ using document root <none> and password file <none>
I20260806 19:33:53.556196 17405 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:53.556329 17405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:53.556649 17405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:53.559993 17405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "a457501bc7fb486aad4e66d0c75241c8"
format_stamp: "Formatted at 2026-08-06 19:33:53 on dist-test-slave-f0tn"
server_key: "bb4a688adc5241bc00d7b33612750da3"
server_key_iv: "573e9f15ef7694b6c49901c43676a97a"
server_key_version: "encryptionkey@0"
I20260806 19:33:53.560855 17405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "a457501bc7fb486aad4e66d0c75241c8"
format_stamp: "Formatted at 2026-08-06 19:33:53 on dist-test-slave-f0tn"
server_key: "bb4a688adc5241bc00d7b33612750da3"
server_key_iv: "573e9f15ef7694b6c49901c43676a97a"
server_key_version: "encryptionkey@0"
I20260806 19:33:53.566859 17405 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260806 19:33:53.570930 17440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:53.572607 17405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 19:33:53.572830 17405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "a457501bc7fb486aad4e66d0c75241c8"
format_stamp: "Formatted at 2026-08-06 19:33:53 on dist-test-slave-f0tn"
server_key: "bb4a688adc5241bc00d7b33612750da3"
server_key_iv: "573e9f15ef7694b6c49901c43676a97a"
server_key_version: "encryptionkey@0"
I20260806 19:33:53.573079 17405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:53.579595 17405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:53.584398 17405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:53.584723 17405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:53.603735 17405 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:37869
I20260806 19:33:53.603785 17514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:37869 every 8 connection(s)
I20260806 19:33:53.605285 17405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:53.609565 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:53.612375 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17405
I20260806 19:33:53.612547 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:53.612983 17481 external_mini_cluster.cc:1428] Setting key 916042a0f6786b962afd991c385f2789
I20260806 19:33:53.621511 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:53.614999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35125 (local address 127.17.18.126:37869)
0806 19:33:53.615912 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:53.615926 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:53.615973 (+ 47us) server_negotiation.cc:407] Connection header received
0806 19:33:53.617811 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:53.617845 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:53.618237 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:53.618615 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:53.619822 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:53.619829 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:53.619844 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:53.619860 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:53.619933 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:53.619953 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:53.620151 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:53.620253 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 19:33:53.620452 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":380,"threads_started":1}
I20260806 19:33:53.622368 17515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8: Bootstrap starting.
I20260806 19:33:53.625922 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:53.626343 17515 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:53.627450 17515 log.cc:824] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:53.631417 17515 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8: No bootstrap required, opened a new log
I20260806 19:33:53.633426 17519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:53.630757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59331 (local address 127.17.18.126:37869)
0806 19:33:53.630917 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:53.630921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:53.631447 (+ 526us) server_negotiation.cc:407] Connection header received
0806 19:33:53.631631 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:53.631635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:53.631689 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:53.631777 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:53.632706 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:53.632713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:53.632717 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:53.632736 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:53.632779 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:53.632795 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:53.632900 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:53.633011 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 19:33:53.633077 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 19:33:53.641065 17515 raft_consensus.cc:348] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } }
I20260806 19:33:53.641618 17515 raft_consensus.cc:374] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:53.641757 17515 raft_consensus.cc:729] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a457501bc7fb486aad4e66d0c75241c8, State: Initialized, Role: FOLLOWER
I20260806 19:33:53.642467 17515 consensus_queue.cc:260] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } }
I20260806 19:33:53.642755 17515 raft_consensus.cc:388] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:53.642915 17515 raft_consensus.cc:482] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:53.643110 17515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:53.646307 17515 raft_consensus.cc:504] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } }
I20260806 19:33:53.646948 17515 leader_election.cc:302] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a457501bc7fb486aad4e66d0c75241c8; no voters:
I20260806 19:33:53.647629 17515 leader_election.cc:288] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:53.647778 17531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:53.648615 17531 raft_consensus.cc:686] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [term 1 LEADER]: Becoming Leader. State: Replica: a457501bc7fb486aad4e66d0c75241c8, State: Running, Role: LEADER
I20260806 19:33:53.649202 17531 consensus_queue.cc:237] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } }
I20260806 19:33:53.650226 17515 sys_catalog.cc:564] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:53.651867 17535 sys_catalog.cc:455] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a457501bc7fb486aad4e66d0c75241c8. Latest consensus state: current_term: 1 leader_uuid: "a457501bc7fb486aad4e66d0c75241c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } } }
I20260806 19:33:53.652288 17535 sys_catalog.cc:458] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:53.652763 17533 sys_catalog.cc:455] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a457501bc7fb486aad4e66d0c75241c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a457501bc7fb486aad4e66d0c75241c8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37869 } } }
I20260806 19:33:53.653221 17533 sys_catalog.cc:458] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:53.663731 17540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:53.669952 17540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:53.680372 17540 catalog_manager.cc:1347] Generated new cluster ID: 0d95f4ce4fe5432dbbca2b07dd8bad3c
I20260806 19:33:53.680522 17540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:53.726181 17540 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:53.726778 17540 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:53.738510 17540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a457501bc7fb486aad4e66d0c75241c8: Generated new TSK 0
I20260806 19:33:53.739818 17540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:53.761003 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17405
W20260806 19:33:53.762238 17509 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35125
W20260806 19:33:53.762976 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17405: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:53.763123 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17405
2026-08-06T19:33:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2296 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:53 dist-test-slave-f0tn krb5kdc[17562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:53 dist-test-slave-f0tn krb5kdc[17562](info): set up 2 sockets
Aug 06 19:33:53 dist-test-slave-f0tn krb5kdc[17562](info): commencing operation
krb5kdc: starting...
W20260806 19:33:55.024011 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.006s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:55 dist-test-slave-f0tn krb5kdc[17562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:55.408581 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40167
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:44439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:40167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:55.787350 17584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:55.787719 17584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:55.787856 17584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:55.795451 17584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:55.795611 17584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:55.795701 17584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:55.795789 17584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:55.795852 17584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:55.807376 17584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:44439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:40167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:40167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:55.808940 17584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:55.810474 17584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:55.824893 17593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:55.824846 17596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:55.824925 17594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:55.825780 17584 server_base.cc:1034] running on GCE node
I20260806 19:33:55.826709 17584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:55.828379 17584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:55.829599 17584 hybrid_clock.cc:648] HybridClock initialized: now 1786044835829550 us; error 64 us; skew 500 ppm
I20260806 19:33:55.829998 17584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:55 dist-test-slave-f0tn krb5kdc[17562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044835, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:55.833654 17584 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:55.835484 17584 webserver.cc:460] Webserver started at http://127.17.18.126:33913/ using document root <none> and password file <none>
I20260806 19:33:55.836288 17584 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:55.836436 17584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:55.836768 17584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:55.840133 17584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "e6629e2e586a423abd09303a40fb23d8"
format_stamp: "Formatted at 2026-08-06 19:33:55 on dist-test-slave-f0tn"
server_key: "426b554b3fc03137edce3eb83dde8a29"
server_key_iv: "b3ce9789d37d28781dbfc33762951f31"
server_key_version: "encryptionkey@0"
I20260806 19:33:55.841027 17584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "e6629e2e586a423abd09303a40fb23d8"
format_stamp: "Formatted at 2026-08-06 19:33:55 on dist-test-slave-f0tn"
server_key: "426b554b3fc03137edce3eb83dde8a29"
server_key_iv: "b3ce9789d37d28781dbfc33762951f31"
server_key_version: "encryptionkey@0"
I20260806 19:33:55.847007 17584 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 19:33:55.851464 17605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:55.853209 17584 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 19:33:55.853475 17584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "e6629e2e586a423abd09303a40fb23d8"
format_stamp: "Formatted at 2026-08-06 19:33:55 on dist-test-slave-f0tn"
server_key: "426b554b3fc03137edce3eb83dde8a29"
server_key_iv: "b3ce9789d37d28781dbfc33762951f31"
server_key_version: "encryptionkey@0"
I20260806 19:33:55.853734 17584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:55.889158 17584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:55.894196 17584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:55.894524 17584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:55.915169 17669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:40167 every 8 connection(s)
I20260806 19:33:55.915135 17584 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:40167
I20260806 19:33:55.916862 17584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:55.918335 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17584
I20260806 19:33:55.918532 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:55.919085 17481 external_mini_cluster.cc:1428] Setting key 68417f6115ea1b1dc7e4149217f4a003
I20260806 19:33:55.922516 17672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 19:33:55 dist-test-slave-f0tn krb5kdc[17562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:33:55.937116 17672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8: Bootstrap starting.
I20260806 19:33:55.941776 17672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:55.943245 17672 log.cc:824] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:55.946586 17675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:55.921122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55097 (local address 127.17.18.126:40167)
0806 19:33:55.921999 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:55.922012 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:55.922057 (+ 45us) server_negotiation.cc:407] Connection header received
0806 19:33:55.923826 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:55.923853 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:55.924301 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:55.924841 (+ 540us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:55.926842 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:55.928497 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:55.930469 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:55.931229 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:55.931388 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:55.936761 (+ 5373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:55.936775 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:55.936799 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:55.936864 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:55.941092 (+ 4228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:55.942226 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:55.942242 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:55.942253 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:55.942518 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:55.943053 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:55.943058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:55.943061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:55.943870 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:55.944184 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:55.944710 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 19:33:55.945194 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":384,"threads_started":1}
I20260806 19:33:55.947310 17672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8: No bootstrap required, opened a new log
I20260806 19:33:55.950891 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:55.958189 17672 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } }
I20260806 19:33:55.958755 17672 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:55.958871 17672 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6629e2e586a423abd09303a40fb23d8, State: Initialized, Role: FOLLOWER
I20260806 19:33:55.959659 17672 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } }
I20260806 19:33:55.959981 17672 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:55.960143 17672 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:55.960341 17672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:55.963551 17672 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } }
I20260806 19:33:55.964257 17672 leader_election.cc:302] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6629e2e586a423abd09303a40fb23d8; no voters:
I20260806 19:33:55.964999 17672 leader_election.cc:288] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:55.965098 17688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:55.966768 17688 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [term 1 LEADER]: Becoming Leader. State: Replica: e6629e2e586a423abd09303a40fb23d8, State: Running, Role: LEADER
I20260806 19:33:55.967566 17672 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:55.967509 17688 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } }
I20260806 19:33:55.972615 17689 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6629e2e586a423abd09303a40fb23d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } } }
I20260806 19:33:55.972664 17690 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6629e2e586a423abd09303a40fb23d8. Latest consensus state: current_term: 1 leader_uuid: "e6629e2e586a423abd09303a40fb23d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6629e2e586a423abd09303a40fb23d8" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 40167 } } }
I20260806 19:33:55.973109 17689 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:55.973109 17690 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:55.974349 17699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:55.975427 17675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:55.956849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32943 (local address 127.17.18.126:40167)
0806 19:33:55.957076 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:55.957082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:55.957476 (+ 394us) server_negotiation.cc:407] Connection header received
0806 19:33:55.957660 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:55.957665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:55.957740 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:55.957848 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:55.959999 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:55.960929 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:55.962836 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:55.963298 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:55.963402 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:55.966666 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:55.966673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:55.966679 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:33:55.966741 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:55.970871 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:55.971863 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:55.971870 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:55.971874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:55.972146 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:33:55.972674 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:33:55.972679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:33:55.972682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:33:55.973151 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:55.973496 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:55.974826 (+ 1330us) server_negotiation.cc:299] Negotiation successful
0806 19:33:55.975055 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 19:33:55.982156 17699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:56.002444 17699 catalog_manager.cc:1347] Generated new cluster ID: 09d438081e8143f78381c9aa39a1196f
I20260806 19:33:56.002597 17699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:56.010632 17699 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:56.012292 17699 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:56.023968 17699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6629e2e586a423abd09303a40fb23d8: Generated new TSK 0
I20260806 19:33:56.024945 17699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:56.036234 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17584
I20260806 19:33:56.037532 17665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:33:56.130929 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17584
2026-08-06T19:33:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2370 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:56 dist-test-slave-f0tn krb5kdc[17716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:56 dist-test-slave-f0tn krb5kdc[17716](info): set up 2 sockets
Aug 06 19:33:56 dist-test-slave-f0tn krb5kdc[17716](info): commencing operation
krb5kdc: starting...
W20260806 19:33:57.401793 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:57 dist-test-slave-f0tn krb5kdc[17716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:33:57.789716 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:46357
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:37699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:46357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:33:58.174193 17740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:33:58.174561 17740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:33:58.174705 17740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:33:58.182449 17740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:33:58.182610 17740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:33:58.182696 17740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:33:58.182780 17740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:33:58.182844 17740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:33:58.195976 17740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:37699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:46357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:46357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:33:58.197590 17740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:33:58.199016 17740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:33:58.212792 17749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:58.212695 17750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:33:58.212746 17753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:33:58.213955 17740 server_base.cc:1034] running on GCE node
I20260806 19:33:58.214870 17740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:33:58.216465 17740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:33:58.217694 17740 hybrid_clock.cc:648] HybridClock initialized: now 1786044838217646 us; error 37 us; skew 500 ppm
I20260806 19:33:58.218101 17740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:33:58 dist-test-slave-f0tn krb5kdc[17716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044838, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:33:58.226969 17740 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:33:58.229017 17740 webserver.cc:460] Webserver started at http://127.17.18.126:38113/ using document root <none> and password file <none>
I20260806 19:33:58.229939 17740 fs_manager.cc:359] Metadata directory not provided
I20260806 19:33:58.230091 17740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:33:58.230432 17740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:33:58.234319 17740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "73352b0fdab5400b92b7297a19dd2f89"
format_stamp: "Formatted at 2026-08-06 19:33:58 on dist-test-slave-f0tn"
server_key: "6097259b877a623c2f50b1f59256040b"
server_key_iv: "e9d921eb4287a9f34d8245803f87cd06"
server_key_version: "encryptionkey@0"
I20260806 19:33:58.235200 17740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "73352b0fdab5400b92b7297a19dd2f89"
format_stamp: "Formatted at 2026-08-06 19:33:58 on dist-test-slave-f0tn"
server_key: "6097259b877a623c2f50b1f59256040b"
server_key_iv: "e9d921eb4287a9f34d8245803f87cd06"
server_key_version: "encryptionkey@0"
I20260806 19:33:58.241181 17740 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 19:33:58.245424 17761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:33:58.247082 17740 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 19:33:58.247306 17740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "73352b0fdab5400b92b7297a19dd2f89"
format_stamp: "Formatted at 2026-08-06 19:33:58 on dist-test-slave-f0tn"
server_key: "6097259b877a623c2f50b1f59256040b"
server_key_iv: "e9d921eb4287a9f34d8245803f87cd06"
server_key_version: "encryptionkey@0"
I20260806 19:33:58.247527 17740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:33:58.281683 17740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:33:58.286829 17740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:33:58.287164 17740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:33:58.307457 17740 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:46357
I20260806 19:33:58.307477 17828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:46357 every 8 connection(s)
I20260806 19:33:58.308928 17740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:33:58.309801 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17740
I20260806 19:33:58.309978 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:33:58.310552 17481 external_mini_cluster.cc:1428] Setting key 4abd0fb1ad504816057a9bdfb87c2e21
I20260806 19:33:58.313868 17829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:33:58.326375 17834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:58.312600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46343 (local address 127.17.18.126:46357)
0806 19:33:58.313575 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:58.313589 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:58.313640 (+ 51us) server_negotiation.cc:407] Connection header received
0806 19:33:58.315426 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:58.315453 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:58.315903 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:58.316321 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:58.316971 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:58.318402 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:58.319927 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:58.321215 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:58.321473 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:58.323328 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:58.323338 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:58.323361 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:58.324205 (+ 844us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:58.324330 (+ 125us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:58.324365 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:58.324518 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:58.324850 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 19:33:58.325182 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":398,"threads_started":1}
I20260806 19:33:58.327526 17829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89: Bootstrap starting.
I20260806 19:33:58.330965 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:33:58.331727 17829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89: Neither blocks nor log segments found. Creating new log.
I20260806 19:33:58.332919 17829 log.cc:824] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89: Log is configured to *not* fsync() on all Append() calls
I20260806 19:33:58.336948 17829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89: No bootstrap required, opened a new log
I20260806 19:33:58.342526 17834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:33:58.335806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57581 (local address 127.17.18.126:46357)
0806 19:33:58.335973 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 19:33:58.335979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:33:58.336573 (+ 594us) server_negotiation.cc:407] Connection header received
0806 19:33:58.336781 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:33:58.336785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:33:58.336855 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:33:58.336946 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:33:58.337548 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:58.338299 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:58.339764 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:33:58.340287 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:33:58.340415 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:33:58.341706 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:33:58.341711 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:33:58.341717 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:33:58.341759 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:33:58.341805 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:33:58.341826 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:33:58.341918 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 19:33:58.342081 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 19:33:58.342197 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 19:33:58.345790 17829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } }
I20260806 19:33:58.346244 17829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:33:58.346374 17829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73352b0fdab5400b92b7297a19dd2f89, State: Initialized, Role: FOLLOWER
I20260806 19:33:58.347038 17829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } }
I20260806 19:33:58.347292 17829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:33:58.347446 17829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:33:58.347628 17829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:33:58.350515 17829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } }
I20260806 19:33:58.351099 17829 leader_election.cc:302] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73352b0fdab5400b92b7297a19dd2f89; no voters:
I20260806 19:33:58.351866 17829 leader_election.cc:288] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:33:58.352013 17843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:33:58.352766 17843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [term 1 LEADER]: Becoming Leader. State: Replica: 73352b0fdab5400b92b7297a19dd2f89, State: Running, Role: LEADER
I20260806 19:33:58.353406 17843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } }
I20260806 19:33:58.354197 17829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:33:58.356431 17848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73352b0fdab5400b92b7297a19dd2f89. Latest consensus state: current_term: 1 leader_uuid: "73352b0fdab5400b92b7297a19dd2f89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } } }
I20260806 19:33:58.356657 17846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73352b0fdab5400b92b7297a19dd2f89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73352b0fdab5400b92b7297a19dd2f89" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 46357 } } }
I20260806 19:33:58.356902 17848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:58.356932 17846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89 [sys.catalog]: This master's current role is: LEADER
I20260806 19:33:58.358217 17855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:33:58.365031 17855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:33:58.375191 17855 catalog_manager.cc:1347] Generated new cluster ID: 2c8e58adc8af47079ddf6fc63581d5c3
I20260806 19:33:58.375337 17855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:33:58.393895 17855 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:33:58.395350 17855 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:33:58.403281 17855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73352b0fdab5400b92b7297a19dd2f89: Generated new TSK 0
I20260806 19:33:58.404273 17855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:33:58.413965 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17740
W20260806 19:33:58.415153 17824 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46343
W20260806 19:33:58.415912 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17740: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:33:58.416039 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17740
2026-08-06T19:33:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2283 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:33:58 dist-test-slave-f0tn krb5kdc[17873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:33:58 dist-test-slave-f0tn krb5kdc[17873](info): set up 2 sockets
Aug 06 19:33:58 dist-test-slave-f0tn krb5kdc[17873](info): commencing operation
krb5kdc: starting...
W20260806 19:33:59.691675 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.006s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:33:59 dist-test-slave-f0tn krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:33:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:33:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:34:00.089295 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43803
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:34:00.466313 17892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:00.466698 17892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:00.466869 17892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:00.474589 17892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:00.474761 17892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:00.474853 17892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:00.474949 17892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:00.475023 17892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:00.485886 17892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:00.487411 17892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:00.488931 17892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:00.502756 17899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:00.502692 17901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:00.502744 17905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:00.503506 17892 server_base.cc:1034] running on GCE node
I20260806 19:34:00.504482 17892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:00.506166 17892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:00.507421 17892 hybrid_clock.cc:648] HybridClock initialized: now 1786044840507363 us; error 53 us; skew 500 ppm
I20260806 19:34:00.507807 17892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:00 dist-test-slave-f0tn krb5kdc[17873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044840, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:00.511168 17892 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:34:00.513782 17892 webserver.cc:460] Webserver started at http://127.17.18.126:37959/ using document root <none> and password file <none>
I20260806 19:34:00.514745 17892 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:00.514899 17892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:00.515316 17892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:00.519930 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "d99762ea2b964035a78af9a2eb1cdf4a"
format_stamp: "Formatted at 2026-08-06 19:34:00 on dist-test-slave-f0tn"
server_key: "cb062819b78f890e9638f3ce782938d9"
server_key_iv: "ab2f1a6deb1c30b3cb464151cca6450e"
server_key_version: "encryptionkey@0"
I20260806 19:34:00.521092 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "d99762ea2b964035a78af9a2eb1cdf4a"
format_stamp: "Formatted at 2026-08-06 19:34:00 on dist-test-slave-f0tn"
server_key: "cb062819b78f890e9638f3ce782938d9"
server_key_iv: "ab2f1a6deb1c30b3cb464151cca6450e"
server_key_version: "encryptionkey@0"
I20260806 19:34:00.528942 17892 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.003s
I20260806 19:34:00.533272 17913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:00.534962 17892 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 19:34:00.535188 17892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "d99762ea2b964035a78af9a2eb1cdf4a"
format_stamp: "Formatted at 2026-08-06 19:34:00 on dist-test-slave-f0tn"
server_key: "cb062819b78f890e9638f3ce782938d9"
server_key_iv: "ab2f1a6deb1c30b3cb464151cca6450e"
server_key_version: "encryptionkey@0"
I20260806 19:34:00.535406 17892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:00.542006 17892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:00.546531 17892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:00.546842 17892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:00.566535 17892 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43803
I20260806 19:34:00.566568 17981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43803 every 8 connection(s)
I20260806 19:34:00.568225 17892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:34:00.569267 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 17892
I20260806 19:34:00.569489 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:34:00.570040 17481 external_mini_cluster.cc:1428] Setting key e12c02339da5a324bc12d9e4520312f3
I20260806 19:34:00.573539 17982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:00.578670 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:00.572131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54975 (local address 127.17.18.126:43803)
0806 19:34:00.572988 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:00.573002 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:00.573046 (+ 44us) server_negotiation.cc:407] Connection header received
0806 19:34:00.574894 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:00.574920 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:00.575293 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:00.575682 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:00.576858 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:00.576864 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:00.576879 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:34:00.576903 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:00.576983 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:34:00.577010 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:00.577262 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:00.577443 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 19:34:00.577643 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":365,"threads_started":1}
I20260806 19:34:00.582799 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:34:00.585774 17982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a: Bootstrap starting.
I20260806 19:34:00.589792 17982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:00.590248 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:00.587413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43665 (local address 127.17.18.126:43803)
0806 19:34:00.587612 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:00.587617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:00.587929 (+ 312us) server_negotiation.cc:407] Connection header received
0806 19:34:00.588151 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:00.588155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:00.588237 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:00.588328 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:00.589370 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:00.589404 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:00.589409 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 19:34:00.589432 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:00.589484 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 19:34:00.589503 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:00.589619 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:00.589837 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 19:34:00.589897 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 19:34:00.591200 17982 log.cc:824] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:00.594555 17982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a: No bootstrap required, opened a new log
I20260806 19:34:00.602823 17982 raft_consensus.cc:348] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } }
I20260806 19:34:00.603272 17982 raft_consensus.cc:374] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 19:34:00.603380 17982 raft_consensus.cc:729] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d99762ea2b964035a78af9a2eb1cdf4a, State: Initialized, Role: FOLLOWER
I20260806 19:34:00.604004 17982 consensus_queue.cc:260] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } }
I20260806 19:34:00.604231 17982 raft_consensus.cc:388] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 19:34:00.604369 17982 raft_consensus.cc:482] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 19:34:00.604532 17982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:00.606896 17982 raft_consensus.cc:504] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } }
I20260806 19:34:00.607442 17982 leader_election.cc:302] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d99762ea2b964035a78af9a2eb1cdf4a; no voters:
I20260806 19:34:00.608178 17982 leader_election.cc:288] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 19:34:00.608331 17996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:34:00.609072 17996 raft_consensus.cc:686] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [term 1 LEADER]: Becoming Leader. State: Replica: d99762ea2b964035a78af9a2eb1cdf4a, State: Running, Role: LEADER
I20260806 19:34:00.609792 17996 consensus_queue.cc:237] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } }
I20260806 19:34:00.610430 17982 sys_catalog.cc:564] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:34:00.612918 18000 sys_catalog.cc:455] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d99762ea2b964035a78af9a2eb1cdf4a. Latest consensus state: current_term: 1 leader_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } } }
I20260806 19:34:00.613502 18000 sys_catalog.cc:458] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:00.612877 17997 sys_catalog.cc:455] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d99762ea2b964035a78af9a2eb1cdf4a" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43803 } } }
I20260806 19:34:00.613677 17997 sys_catalog.cc:458] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:00.615399 18005 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:34:00.621896 18005 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:34:00.633684 18005 catalog_manager.cc:1347] Generated new cluster ID: 18c3ea5b883a4fcd9d911243ff250411
I20260806 19:34:00.633867 18005 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:34:00.660959 18005 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:34:00.661545 18005 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:34:00.671670 18005 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d99762ea2b964035a78af9a2eb1cdf4a: Generated new TSK 0
I20260806 19:34:00.672590 18005 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 19:34:00.690893 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17892
W20260806 19:34:00.692242 17975 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54975
W20260806 19:34:00.693005 17481 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 17892: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 19:34:00.693152 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 17892
2026-08-06T19:34:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2278 ms)
[----------] 18 tests from AuthTokenIssuingTest (41356 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:34:00 dist-test-slave-f0tn krb5kdc[18028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:34:00 dist-test-slave-f0tn krb5kdc[18028](info): set up 2 sockets
Aug 06 19:34:00 dist-test-slave-f0tn krb5kdc[18028](info): commencing operation
krb5kdc: starting...
W20260806 19:34:01.970783 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.009s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:34:02 dist-test-slave-f0tn krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:34:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:34:02.378585 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37663
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:34:02.756286 18044 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:02.756692 18044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:02.756799 18044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:02.756925 18044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:02.764618 18044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:02.764737 18044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:02.764837 18044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:02.764906 18044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:02.764997 18044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:02.775563 18044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:37663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:02.777041 18044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:02.778529 18044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:02.790764 18051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:02.790844 18052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:02.790798 18055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:02.791651 18044 server_base.cc:1034] running on GCE node
I20260806 19:34:02.792531 18044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:02.794107 18044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:02.795358 18044 hybrid_clock.cc:648] HybridClock initialized: now 1786044842795281 us; error 47 us; skew 500 ppm
I20260806 19:34:02.795729 18044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:02 dist-test-slave-f0tn krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:02.799088 18044 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:34:02.800693 18044 webserver.cc:460] Webserver started at http://127.17.18.126:40281/ using document root <none> and password file <none>
I20260806 19:34:02.801503 18044 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:02.801622 18044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:02.801973 18044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:02.805483 18044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "d0214bf3199e4dccaf644c40d5473244"
format_stamp: "Formatted at 2026-08-06 19:34:02 on dist-test-slave-f0tn"
server_key: "e10c35dadefdc27ed205a740ce0b0c8e"
server_key_iv: "c163864df24a18aa3d1f4d156d012313"
server_key_version: "encryptionkey@0"
I20260806 19:34:02.806442 18044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "d0214bf3199e4dccaf644c40d5473244"
format_stamp: "Formatted at 2026-08-06 19:34:02 on dist-test-slave-f0tn"
server_key: "e10c35dadefdc27ed205a740ce0b0c8e"
server_key_iv: "c163864df24a18aa3d1f4d156d012313"
server_key_version: "encryptionkey@0"
I20260806 19:34:02.813231 18044 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 19:34:02.817803 18063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:02.819713 18044 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 19:34:02.819958 18044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "d0214bf3199e4dccaf644c40d5473244"
format_stamp: "Formatted at 2026-08-06 19:34:02 on dist-test-slave-f0tn"
server_key: "e10c35dadefdc27ed205a740ce0b0c8e"
server_key_iv: "c163864df24a18aa3d1f4d156d012313"
server_key_version: "encryptionkey@0"
I20260806 19:34:02.820245 18044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:02.857034 18044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:02.862349 18044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:02.862673 18044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:02.883415 18044 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:37663
I20260806 19:34:02.883457 18134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:37663 every 8 connection(s)
I20260806 19:34:02.884889 18044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:34:02.887769 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18044
I20260806 19:34:02.887972 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:34:02.888616 17481 external_mini_cluster.cc:1428] Setting key cb261ff0f4d7e854f82f8d6ae42126a4
I20260806 19:34:02.889019 18136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:02.896000 18136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:02 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:02.920038 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.900897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.17.18.126:37663)
0806 19:34:02.901723 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:02.901758 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:02.901820 (+ 62us) server_negotiation.cc:407] Connection header received
0806 19:34:02.903167 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:02.903174 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:02.903425 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:02.903619 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:02.905039 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:02.906338 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:02.907739 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:02.908307 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:02.908479 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:02.912294 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:02.912304 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:02.912319 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:02.912353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:02.915304 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:02.916288 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:02.916296 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:02.916298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:02.916467 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:02.916960 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:02.916964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:02.916966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:02.917601 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:02.917780 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:02.918557 (+ 777us) server_negotiation.cc:299] Negotiation successful
0806 19:34:02.918862 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":601,"thread_start_us":375,"threads_started":1}
I20260806 19:34:02.920104 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.899506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37663 (local address 127.0.0.1:34400)
0806 19:34:02.900430 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:02.900473 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:02.902760 (+ 2287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:02.903685 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:02.903692 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:02.904445 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:02.904814 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:02.904833 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:02.906502 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:02.906506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:02.907586 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:02.907599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:02.908564 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:02.908571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:02.908760 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:02.909438 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:02.909465 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:02.911991 (+ 2526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:02.915472 (+ 3481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:02.915487 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:02.915503 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:02.916122 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:02.916595 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:02.916600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:02.916603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:02.916836 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:02.917761 (+ 925us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:02.917769 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:02.918035 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 19:34:02.918328 (+ 293us) client_negotiation.cc:240] Negotiation successful
0806 19:34:02.919071 (+ 743us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":166,"thread_start_us":378,"threads_started":1}
WARNING: no policy specified for kudu/127.17.18.125@KRBTEST.COM; defaulting to no policy
I20260806 19:34:02.923225 18136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:02.924494 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.923998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44474)
0806 19:34:02.924219 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:02.924342 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260806 19:34:02.924849 18065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.125@KRBTEST.COM" created.
I20260806 19:34:02.926719 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.926307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44488)
0806 19:34:02.926472 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:02.926562 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 19:34:02.926928 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:46615: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
I20260806 19:34:02.970217 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:46615
--webserver_interface=127.17.18.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:34:02.976344 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } attempt: 1
I20260806 19:34:02.977761 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.977182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44504)
0806 19:34:02.977444 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:02.977587 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 19:34:02.978907 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:02.978519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44518)
0806 19:34:02.978671 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:02.978752 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 19:34:02.979144 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:46615: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
I20260806 19:34:03.047438 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } attempt: 2
I20260806 19:34:03.048677 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.048172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44528)
0806 19:34:03.048436 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.048530 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 19:34:03.049968 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.049568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44538)
0806 19:34:03.049727 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.049822 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 19:34:03.050189 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:46615: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
I20260806 19:34:03.141496 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } attempt: 3
I20260806 19:34:03.142809 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.142312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44552)
0806 19:34:03.142559 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.142659 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 19:34:03.143971 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.143534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44568)
0806 19:34:03.143724 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.143809 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 19:34:03.144244 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:46615: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
I20260806 19:34:03.287549 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } attempt: 4
I20260806 19:34:03.289026 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.288330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44570)
0806 19:34:03.288739 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.288837 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219}
I20260806 19:34:03.290197 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.289786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44584)
0806 19:34:03.289957 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.290058 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 19:34:03.290421 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:46615: Network error: Client connection negotiation failed: client connection to 127.17.18.125:46615: connect: Connection refused (error 111)
W20260806 19:34:03.347172 18143 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:03.347640 18143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:03.347748 18143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:03.347875 18143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:03.356000 18143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:03.356138 18143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:03.356240 18143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:03.356314 18143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:03.356403 18143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:03.367224 18143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:46615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.18.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:03.368774 18143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:03.370251 18143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:03.383224 18148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:03.383132 18149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:03.383159 18151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:03.383898 18143 server_base.cc:1034] running on GCE node
I20260806 19:34:03.384757 18143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:03.386474 18143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:03.387738 18143 hybrid_clock.cc:648] HybridClock initialized: now 1786044843387677 us; error 35 us; skew 500 ppm
I20260806 19:34:03.388168 18143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:03 dist-test-slave-f0tn krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:03.395525 18143 init.cc:377] Logged in from keytab as kudu/127.17.18.125@KRBTEST.COM (short username kudu)
I20260806 19:34:03.397261 18143 webserver.cc:460] Webserver started at http://127.17.18.125:39135/ using document root <none> and password file <none>
I20260806 19:34:03.398101 18143 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:03.398243 18143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:03.398600 18143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:03.401896 18143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data/instance:
uuid: "f038291af910400c8f40ae19cbb389c8"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "00f410f0f869f2bed80b22167d49b6ae"
server_key_iv: "bde67d948d1b3bd71568546baeadb882"
server_key_version: "encryptionkey@0"
I20260806 19:34:03.402699 18143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal/instance:
uuid: "f038291af910400c8f40ae19cbb389c8"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "00f410f0f869f2bed80b22167d49b6ae"
server_key_iv: "bde67d948d1b3bd71568546baeadb882"
server_key_version: "encryptionkey@0"
I20260806 19:34:03.408488 18143 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 19:34:03.412601 18162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:03.414357 18143 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:34:03.414565 18143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "f038291af910400c8f40ae19cbb389c8"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "00f410f0f869f2bed80b22167d49b6ae"
server_key_iv: "bde67d948d1b3bd71568546baeadb882"
server_key_version: "encryptionkey@0"
I20260806 19:34:03.414893 18143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:03.430142 18143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:03.435195 18143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:03.435515 18143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:03.455366 18143 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.125:46615
I20260806 19:34:03.455389 18236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.125:46615 every 8 connection(s)
I20260806 19:34:03.456913 18143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
I20260806 19:34:03.459954 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18143
I20260806 19:34:03.460196 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-1/wal/instance
I20260806 19:34:03.460664 17481 external_mini_cluster.cc:1428] Setting key 2ade3adad243d894f221083c57639c84
I20260806 19:34:03.461882 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:03.469754 18237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:03 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:03.492439 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.472810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.17.18.126:37663)
0806 19:34:03.473460 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:03.473467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:03.474723 (+ 1256us) server_negotiation.cc:407] Connection header received
0806 19:34:03.476862 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:03.476869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:03.476958 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:03.477087 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:03.479368 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.480115 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.481864 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.482311 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.482442 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.486249 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:03.486255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:03.486259 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:03.486308 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:03.489059 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.489951 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.489956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.489958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.490087 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.490544 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.490548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.490550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.490849 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:03.491007 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:03.491780 (+ 773us) server_negotiation.cc:299] Negotiation successful
0806 19:34:03.492029 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":288,"threads_started":1}
I20260806 19:34:03.493564 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.473427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37663 (local address 127.0.0.1:34404)
0806 19:34:03.474501 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.474554 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:03.476512 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:03.477318 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:03.477327 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:03.478155 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:03.479055 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.479088 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.480298 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.480303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.481641 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.481655 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.482584 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.482592 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.482856 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.483565 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:03.483592 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:03.485950 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:03.489236 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.489248 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.489263 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.489803 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.490212 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.490216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.490218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.490417 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.491003 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:03.491011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:03.491388 (+ 377us) client_negotiation.cc:769] Sending connection context
0806 19:34:03.491648 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 19:34:03.492225 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":416,"threads_started":1}
I20260806 19:34:03.495606 18237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.18.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.124@KRBTEST.COM" created.
Aug 06 19:34:03 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:03.511242 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.496491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44590)
0806 19:34:03.496729 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.496747 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:03.496849 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:03.497866 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:03.497870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:03.498286 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:03.498445 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.498454 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.500039 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.500043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.500906 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.500919 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.501890 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.501896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.502065 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.502735 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:03.502757 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:03.505093 (+ 2336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:03.508527 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.508531 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.508534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.508896 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.509315 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.509318 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.509321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.509502 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.510173 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:03.510178 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:03.510318 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 19:34:03.510437 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 19:34:03.510749 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 19:34:03.511276 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.496656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44590 (local address 127.17.18.125:46615)
0806 19:34:03.497361 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:03.497367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:03.497424 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:34:03.497488 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:03.497494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:03.497696 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:03.497820 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:03.498634 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.499897 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.501060 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.501695 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.501839 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.505357 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:03.505374 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:03.505425 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:03.505470 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:03.508344 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.509052 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.509060 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.509062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.509184 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.509625 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.509630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.509632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.510022 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:03.510216 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:03.510634 (+ 418us) server_negotiation.cc:299] Negotiation successful
0806 19:34:03.510871 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":388,"threads_started":1}
I20260806 19:34:03.514355 18237 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:03.515643 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.515087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33202)
0806 19:34:03.515289 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.515446 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 19:34:03.515957 18163 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.517875 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.517464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33214)
0806 19:34:03.517640 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.517742 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 19:34:03.518151 18237 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
I20260806 19:34:03.545571 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:42229
--webserver_interface=127.17.18.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:42573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:34:03.567533 18237 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 1
I20260806 19:34:03.568836 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.568288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33228)
0806 19:34:03.568513 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.568629 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 19:34:03.570092 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.569652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33242)
0806 19:34:03.569857 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.569955 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260806 19:34:03.570369 18237 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.589668 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } attempt: 5
Aug 06 19:34:03 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:03.605244 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.590642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44592 (local address 127.17.18.125:46615)
0806 19:34:03.590874 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:03.590879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:03.590903 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:34:03.591017 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:03.591021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:03.591105 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:03.591196 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:03.592097 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.592814 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.594125 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.594647 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.594769 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.598934 (+ 4165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:03.598940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:03.598944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:03.598986 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:03.601941 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.602966 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.602979 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.602981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.603172 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:03.603683 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:03.603687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:03.603689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:03.604014 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:03.604189 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:03.604738 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 19:34:03.604945 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 19:34:03.605314 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.590519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44592)
0806 19:34:03.590727 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.590749 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:03.590890 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:03.591270 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:03.591275 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:03.591698 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:03.591907 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.591918 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.592972 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.592977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.593937 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:03.593953 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:03.594826 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:03.594832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:03.595030 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:03.595768 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:03.595788 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:03.598534 (+ 2746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:03.602156 (+ 3622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.602163 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.602167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.602785 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.603319 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:03.603324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:03.603328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:03.603526 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:03.604196 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:03.604202 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:03.604400 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 19:34:03.604611 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 19:34:03.604950 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:34:03.606653 18136 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:03.608021 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.607480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33256)
0806 19:34:03.607707 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.607819 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 19:34:03.609413 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.608911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33264)
0806 19:34:03.609100 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.609232 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 19:34:03.609827 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.638629 18237 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 2
I20260806 19:34:03.639927 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.639401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33270)
0806 19:34:03.639627 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.639756 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 19:34:03.641185 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.640730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33280)
0806 19:34:03.640934 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.641043 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260806 19:34:03.641458 18237 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.661144 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 1
I20260806 19:34:03.662537 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.661903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33290)
0806 19:34:03.662170 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.662302 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 19:34:03.663816 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.663367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33298)
0806 19:34:03.663539 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.663642 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 19:34:03.664129 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.732415 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 2
I20260806 19:34:03.732769 18237 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 3
I20260806 19:34:03.733863 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.733247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33300)
0806 19:34:03.733512 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.733631 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 19:34:03.733932 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.733451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33314)
0806 19:34:03.733671 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.733771 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 19:34:03.735073 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.734641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33336)
0806 19:34:03.734838 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.734928 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 19:34:03.735110 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.734641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33330)
0806 19:34:03.734916 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.734993 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260806 19:34:03.735344 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
W20260806 19:34:03.735358 18237 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.841627 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 3
I20260806 19:34:03.842922 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.842402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33344)
0806 19:34:03.842635 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.842733 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 19:34:03.844090 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.843654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33348)
0806 19:34:03.843885 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.843967 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260806 19:34:03.844336 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:03.878628 18237 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 4
I20260806 19:34:03.879942 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.879401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33356)
0806 19:34:03.879685 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.879781 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 19:34:03.881067 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:03.880702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33358)
0806 19:34:03.880870 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:03.880947 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 19:34:03.881361 18237 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
W20260806 19:34:03.936954 18250 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:03.937367 18250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:03.937502 18250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:03.937629 18250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:03.945430 18250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:03.945551 18250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:03.945641 18250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:03.945719 18250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:03.945813 18250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:03.956393 18250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:42573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:37663,127.17.18.125:46615,127.17.18.124:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.18.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:03.957918 18250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:03.959389 18250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:03.972254 18257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:03.972359 18256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:03.972280 18260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:03.973033 18250 server_base.cc:1034] running on GCE node
I20260806 19:34:03.973985 18250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:03.975648 18250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:03.976923 18250 hybrid_clock.cc:648] HybridClock initialized: now 1786044843976840 us; error 54 us; skew 500 ppm
I20260806 19:34:03.977341 18250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:03 dist-test-slave-f0tn krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:03.981048 18250 init.cc:377] Logged in from keytab as kudu/127.17.18.124@KRBTEST.COM (short username kudu)
I20260806 19:34:03.982781 18250 webserver.cc:460] Webserver started at http://127.17.18.124:45443/ using document root <none> and password file <none>
I20260806 19:34:03.983520 18250 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:03.983620 18250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:03.983924 18250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:03.987248 18250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data/instance:
uuid: "04d23fc85c2146cc88373d680b56f8a9"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "1fb11e13597e0070e59d2eab94a46e93"
server_key_iv: "763c024cb7ab66225cb3b520927f03bf"
server_key_version: "encryptionkey@0"
I20260806 19:34:03.988063 18250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal/instance:
uuid: "04d23fc85c2146cc88373d680b56f8a9"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "1fb11e13597e0070e59d2eab94a46e93"
server_key_iv: "763c024cb7ab66225cb3b520927f03bf"
server_key_version: "encryptionkey@0"
I20260806 19:34:03.994174 18250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 19:34:03.998554 18268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:04.000257 18250 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 19:34:04.000445 18250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "04d23fc85c2146cc88373d680b56f8a9"
format_stamp: "Formatted at 2026-08-06 19:34:03 on dist-test-slave-f0tn"
server_key: "1fb11e13597e0070e59d2eab94a46e93"
server_key_iv: "763c024cb7ab66225cb3b520927f03bf"
server_key_version: "encryptionkey@0"
I20260806 19:34:04.000699 18250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:04.018426 18250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:04.021591 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 4
I20260806 19:34:04.022958 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.022418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33362)
0806 19:34:04.022670 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.022778 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 19:34:04.024187 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.023722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33368)
0806 19:34:04.023910 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.024006 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 19:34:04.024492 18250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
W20260806 19:34:04.024482 18136 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:42229: Network error: Client connection negotiation failed: client connection to 127.17.18.124:42229: connect: Connection refused (error 111)
I20260806 19:34:04.024817 18250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:04.043881 18250 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.124:42229
I20260806 19:34:04.043889 18339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.124:42229 every 8 connection(s)
I20260806 19:34:04.045423 18250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
I20260806 19:34:04.049557 18340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:04.055889 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18250
I20260806 19:34:04.056111 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786044445493736-17481-0/minicluster-data/master-2/wal/instance
I20260806 19:34:04.056684 17481 external_mini_cluster.cc:1428] Setting key 359b343973542a5acfb70481be8e44b9
I20260806 19:34:04.057714 18340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:34:04.082404 18345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.061059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.17.18.126:37663)
0806 19:34:04.062582 (+ 1523us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.062588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.062613 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:34:04.063179 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.063185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.063270 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.063381 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.065706 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.066887 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.069272 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.070267 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.070438 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.075247 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.075254 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.075258 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.075299 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.078204 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.079076 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.079080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.079084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.079240 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.079731 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.079735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.079737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.080038 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.080195 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.081159 (+ 964us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.081606 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1393,"thread_start_us":1201,"threads_started":1}
I20260806 19:34:04.083181 18344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.060877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:37663 (local address 127.0.0.1:34416)
0806 19:34:04.061912 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.061998 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:04.062857 (+ 859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:04.063535 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:04.063542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:04.064616 (+ 1074us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:04.065365 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.065436 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.067140 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.067145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.068986 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.069005 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.070556 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.070562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.070830 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.071760 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:04.071795 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:04.074940 (+ 3145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:04.078384 (+ 3444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.078400 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.078413 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.078917 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.079364 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.079369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.079373 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.079587 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.080181 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:04.080190 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:04.080684 (+ 494us) client_negotiation.cc:769] Sending connection context
0806 19:34:04.080970 (+ 286us) client_negotiation.cc:240] Negotiation successful
0806 19:34:04.081759 (+ 789us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":1,"spinlock_wait_cycles":19200,"thread_start_us":393,"threads_started":1}
I20260806 19:34:04.083204 18343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.059106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33374 (local address 127.17.18.124:42229)
0806 19:34:04.060119 (+ 1013us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.060130 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.060176 (+ 46us) server_negotiation.cc:407] Connection header received
0806 19:34:04.062789 (+ 2613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.062817 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.063110 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.063352 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.065736 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.067397 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.069293 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.070484 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.070724 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.075643 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.075654 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.075672 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.075708 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.078641 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.079442 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.079450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.079452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.079595 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.080024 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.080027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.080029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.080605 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.080939 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.081491 (+ 552us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.081968 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":769,"thread_start_us":548,"threads_started":1}
I20260806 19:34:04.085363 18340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:04.101291 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.086757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44606 (local address 127.17.18.125:46615)
0806 19:34:04.087104 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.087111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.087137 (+ 26us) server_negotiation.cc:407] Connection header received
0806 19:34:04.087200 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.087206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.087273 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.087370 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.088178 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.088884 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.090163 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.090598 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.090740 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.094616 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.094639 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.094642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.094681 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.098102 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.098868 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.098873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.098875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.099024 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.099481 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.099485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.099487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.099794 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.099946 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.100759 (+ 813us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.100967 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260806 19:34:04.101423 18344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.086405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:46615 (local address 127.0.0.1:44606)
0806 19:34:04.086595 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.086616 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:04.086744 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:04.087428 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:04.087433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:04.087845 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:04.088002 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.088013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.089036 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.089041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.090000 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.090016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.090755 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.090761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.090964 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.091574 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:04.091593 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:04.094266 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:04.098281 (+ 4015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.098287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.098291 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.098722 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.099163 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.099168 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.099171 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.099354 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.099940 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:04.099944 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:04.100277 (+ 333us) client_negotiation.cc:769] Sending connection context
0806 19:34:04.100588 (+ 311us) client_negotiation.cc:240] Negotiation successful
0806 19:34:04.101050 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 19:34:04.102645 18340 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:04.103668 18345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.087001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.17.18.126:37663)
0806 19:34:04.087173 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.087179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.087329 (+ 150us) server_negotiation.cc:407] Connection header received
0806 19:34:04.087503 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.087508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.087586 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.087670 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.088946 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.089740 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.091271 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.091731 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.091873 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.097042 (+ 5169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.097048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.097052 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.097090 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.100032 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.101337 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.101343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.101346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.101579 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.102117 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.102122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.102124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.102440 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.102722 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.103111 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.103371 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:04.117311 18344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.103458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33384)
0806 19:34:04.103893 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.103912 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:04.104024 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:04.104316 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:04.104321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:04.104860 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:04.105036 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.105049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.106301 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.106306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.107410 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.107425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.108130 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.108135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.108371 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.109002 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:04.109020 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:04.111182 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:04.114388 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.114394 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.114398 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.114930 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.115442 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.115447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.115449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.115640 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.116417 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:04.116422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:04.116582 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 19:34:04.116763 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 19:34:04.117022 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329}
I20260806 19:34:04.117657 18343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.103716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33384 (local address 127.17.18.124:42229)
0806 19:34:04.103896 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.103901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.103958 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:34:04.104131 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.104136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.104195 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.104273 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.105234 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.106116 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.107563 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.107973 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.108093 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.111377 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.111382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.111385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.111416 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.114226 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.115121 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.115127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.115129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.115299 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.115791 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.115796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.115799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.116228 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.116401 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.116903 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.117246 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":57}
I20260806 19:34:04.122263 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.105536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.17.18.125:46615)
0806 19:34:04.105744 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.105749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.106506 (+ 757us) server_negotiation.cc:407] Connection header received
0806 19:34:04.106576 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.106581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.106663 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.106771 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.108098 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.108927 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.110252 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.110768 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.110889 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.115689 (+ 4800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.115695 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.115699 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.115746 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.119205 (+ 3459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.120171 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.120175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.120178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.120356 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.120782 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.120785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.120787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.121077 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.121289 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.121766 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.121962 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 19:34:04.123797 18340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: Bootstrap starting.
I20260806 19:34:04.127869 18340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:04.128078 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:34:04.129346 18340 log.cc:824] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:04.132611 18340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: No bootstrap required, opened a new log
I20260806 19:34:04.131876 18101 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d0214bf3199e4dccaf644c40d5473244"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34424
I20260806 19:34:04.141094 18340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.141566 18340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d23fc85c2146cc88373d680b56f8a9, State: Initialized, Role: FOLLOWER
I20260806 19:34:04.142107 18340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.143488 18348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.143937 18348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.144595 18340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:34:04.155345 18365 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:34:04.155522 18365 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:34:04.152913 18250 master_runner.cc:186] Error getting master registration for 127.17.18.126:37663: OK, instance_id { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" instance_seqno: 1786044842877637 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:34:04.164503 18250 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 19:34:04.180675 18237 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 5
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044843, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:34:04.198576 18244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.181509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33386)
0806 19:34:04.181768 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.181793 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:04.181957 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:04.182364 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:04.182370 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:04.182921 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:04.183151 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.183166 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.184703 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.184709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.186175 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.186195 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.187351 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.187358 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.187633 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.188373 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:04.188399 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:04.191599 (+ 3200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:04.195217 (+ 3618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.195224 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.195228 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.195849 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.196346 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.196352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.196356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.196550 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.197448 (+ 898us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:04.197454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:04.197630 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 19:34:04.197799 (+ 169us) client_negotiation.cc:240] Negotiation successful
0806 19:34:04.198157 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 19:34:04.198597 18343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.181599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33386 (local address 127.17.18.124:42229)
0806 19:34:04.181811 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.181815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.181892 (+ 77us) server_negotiation.cc:407] Connection header received
0806 19:34:04.182097 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.182103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.182190 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.182297 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.183342 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.184502 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.186361 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.187152 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.187286 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.191891 (+ 4605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.191899 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.191905 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.191953 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.195046 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.196018 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.196025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.196029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.196197 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.196711 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.196716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.196720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.197263 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.197459 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.197941 (+ 482us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.198195 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 19:34:04.205207 18237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: Bootstrap starting.
I20260806 19:34:04.209720 18237 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:04.211247 18237 log.cc:824] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:04.215619 18237 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: No bootstrap required, opened a new log
I20260806 19:34:04.227762 18237 raft_consensus.cc:348] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.228261 18237 raft_consensus.cc:729] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f038291af910400c8f40ae19cbb389c8, State: Initialized, Role: FOLLOWER
I20260806 19:34:04.228876 18237 consensus_queue.cc:260] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.230134 18368 sys_catalog.cc:455] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.230589 18368 sys_catalog.cc:458] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.231585 18237 sys_catalog.cc:564] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:34:04.243359 18384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:34:04.243635 18384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:34:04.239847 18143 master_runner.cc:186] Error getting master registration for 127.17.18.126:37663: OK, instance_id { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" instance_seqno: 1786044842877637 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:34:04.249300 18143 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 19:34:04.277556 18275 tablet.cc:2369] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:34:04.301760 18136 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } attempt: 5
Aug 06 19:34:04 dist-test-slave-f0tn krb5kdc[18028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044842, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:34:04.319167 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.302557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:42229 (local address 127.0.0.1:33392)
0806 19:34:04.302863 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:04.302884 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:04.303024 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:04.303444 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:04.303449 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:04.304034 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:04.304256 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.304270 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.305712 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.305718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.306789 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:04.306803 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.307613 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.307619 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:04.307839 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.308612 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:04.308639 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:04.311454 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:04.316052 (+ 4598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.316059 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.316064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.316499 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.316982 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:04.316988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:04.316992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:04.317174 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:04.317977 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:04.317983 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:04.318200 (+ 217us) client_negotiation.cc:769] Sending connection context
0806 19:34:04.318354 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 19:34:04.318731 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260806 19:34:04.319242 18343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.302628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.17.18.124:42229)
0806 19:34:04.302836 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.302842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.302958 (+ 116us) server_negotiation.cc:407] Connection header received
0806 19:34:04.303156 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.303162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.303275 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.303363 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.304413 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.305410 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.306975 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.307437 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.307560 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.311742 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.311750 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.311755 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.311802 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.315872 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.316661 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.316667 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.316672 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.316858 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.317311 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.317316 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.317320 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.317736 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.317890 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.318463 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.318731 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 19:34:04.326224 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: Bootstrap starting.
I20260806 19:34:04.330994 18136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:04.333161 18136 log.cc:824] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:04.337811 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: No bootstrap required, opened a new log
I20260806 19:34:04.346249 18136 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.346830 18136 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0214bf3199e4dccaf644c40d5473244, State: Initialized, Role: FOLLOWER
I20260806 19:34:04.347502 18136 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.348955 18387 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.349713 18387 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.350307 18136 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:34:04.350499 18101 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 19:34:04.350704 18101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:04.354480 18101 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.357684 18200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0214bf3199e4dccaf644c40d5473244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f038291af910400c8f40ae19cbb389c8"
I20260806 19:34:04.358341 18200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:04.362733 18200 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0214bf3199e4dccaf644c40d5473244 in term 1.
I20260806 19:34:04.363955 18065 leader_election.cc:302] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0214bf3199e4dccaf644c40d5473244, f038291af910400c8f40ae19cbb389c8; no voters:
I20260806 19:34:04.366230 18309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0214bf3199e4dccaf644c40d5473244" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "04d23fc85c2146cc88373d680b56f8a9"
W20260806 19:34:04.366812 18070 tablet.cc:2369] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:34:04.366883 18309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:04.371940 18309 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0214bf3199e4dccaf644c40d5473244 in term 1.
I20260806 19:34:04.372979 18101 leader_election.cc:288] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [CANDIDATE]: Term 1 election: Requested vote from peers f038291af910400c8f40ae19cbb389c8 (127.17.18.125:46615), 04d23fc85c2146cc88373d680b56f8a9 (127.17.18.124:42229)
I20260806 19:34:04.382719 18387 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:34:04.387499 18387 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [term 1 LEADER]: Becoming Leader. State: Replica: d0214bf3199e4dccaf644c40d5473244, State: Running, Role: LEADER
I20260806 19:34:04.388651 18387 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } }
I20260806 19:34:04.400153 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0214bf3199e4dccaf644c40d5473244. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.400804 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:04.407073 18411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260806 19:34:04.438444 18168 tablet.cc:2369] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:34:04.448843 18411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:34:04.484058 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.405325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44622 (local address 127.17.18.125:46615)
0806 19:34:04.405579 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.405586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.409637 (+ 4051us) server_negotiation.cc:407] Connection header received
0806 19:34:04.411001 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.411009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.411112 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.411198 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.426671 (+ 15473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.427828 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.439409 (+ 11581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.440167 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.440290 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.460496 (+ 20206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.460505 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.460509 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.460565 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.464753 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.477363 (+ 12610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.477372 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.477397 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.477626 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.479039 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.479045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.479049 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.479534 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.479840 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.483283 (+ 3443us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.483624 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 19:34:04.486521 18345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.403990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34436 (local address 127.17.18.126:37663)
0806 19:34:04.404195 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.404202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.406382 (+ 2180us) server_negotiation.cc:407] Connection header received
0806 19:34:04.413773 (+ 7391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.413780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.413870 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.413945 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.424309 (+ 10364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.425558 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.438073 (+ 12515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.438886 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.439028 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.465613 (+ 26585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.465621 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.465626 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.465722 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.469748 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.478240 (+ 8492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.478249 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.478253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.478476 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.481157 (+ 2681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.481163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.481167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.481802 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.485645 (+ 3843us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.485821 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.486105 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 19:34:04.490130 18343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:04.405555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33404 (local address 127.17.18.124:42229)
0806 19:34:04.405741 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.405747 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.410275 (+ 4528us) server_negotiation.cc:407] Connection header received
0806 19:34:04.416740 (+ 6465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.416747 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.416868 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.416954 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.429290 (+ 12336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.430539 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.443548 (+ 13009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:04.444335 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:04.444458 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:04.471030 (+ 26572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:04.471039 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:04.471045 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:04.471109 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:04.475680 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.480429 (+ 4749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.480436 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.480439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.480647 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:04.484596 (+ 3949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:04.484603 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:04.484607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:04.485093 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:04.485406 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:04.489477 (+ 4071us) server_negotiation.cc:299] Negotiation successful
0806 19:34:04.489763 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 19:34:04.496343 18421 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 19:34:04.525089 18309 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [term 1 FOLLOWER]: Refusing update from remote peer d0214bf3199e4dccaf644c40d5473244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:34:04.525216 18200 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [term 1 FOLLOWER]: Refusing update from remote peer d0214bf3199e4dccaf644c40d5473244: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:34:04.526269 18387 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:34:04.527132 18387 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:34:04.556612 18348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0214bf3199e4dccaf644c40d5473244. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.557027 18348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.565415 18425 mvcc.cc:205] Tried to move back new op lower bound from 7315639683102171136 to 7315639682635923456. Current Snapshot: MvccSnapshot[applied={T|T < 7315639683102171136}]
I20260806 19:34:04.576918 18368 sys_catalog.cc:455] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0214bf3199e4dccaf644c40d5473244. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.577293 18368 sys_catalog.cc:458] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.577353 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.577697 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:04.581288 18411 catalog_manager.cc:1347] Generated new cluster ID: 2e9b2787c0cd481887fbe66c0b755201
I20260806 19:34:04.581586 18411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:34:04.582306 18397 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.582572 18397 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:04.591610 18427 mvcc.cc:205] Tried to move back new op lower bound from 7315639683102171136 to 7315639682635923456. Current Snapshot: MvccSnapshot[applied={T|T < 7315639683102171136}]
I20260806 19:34:04.599442 18348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.599805 18348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.617175 18411 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:34:04.619627 18411 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:34:04.620990 18368 sys_catalog.cc:455] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0214bf3199e4dccaf644c40d5473244" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0214bf3199e4dccaf644c40d5473244" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 37663 } } peers { permanent_uuid: "f038291af910400c8f40ae19cbb389c8" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 46615 } } peers { permanent_uuid: "04d23fc85c2146cc88373d680b56f8a9" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 42229 } } }
I20260806 19:34:04.621312 18368 sys_catalog.cc:458] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:04.651991 18411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0214bf3199e4dccaf644c40d5473244: Generated new TSK 0
I20260806 19:34:04.653395 18411 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:34:04.781680 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.779635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37822 (local address 127.17.18.125:46615)
0806 19:34:04.779884 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.779891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.779918 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:34:04.779996 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.780001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.780112 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.780252 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.781407 (+ 1155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37822: BlockingRecv error: recv got EOF from 127.0.0.1:37822 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 19:34:04.783280 18343 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.779975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50788 (local address 127.17.18.124:42229)
0806 19:34:04.780199 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.780205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.781461 (+ 1256us) server_negotiation.cc:407] Connection header received
0806 19:34:04.781755 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.781763 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.781857 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.781934 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.783000 (+ 1066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50788: BlockingRecv error: recv got EOF from 127.0.0.1:50788 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
W20260806 19:34:04.788815 18345 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.786300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59836 (local address 127.17.18.126:37663)
0806 19:34:04.786558 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.786565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.786952 (+ 387us) server_negotiation.cc:407] Connection header received
0806 19:34:04.787229 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.787236 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.787326 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.787399 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.788534 (+ 1135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59836: BlockingRecv error: recv got EOF from 127.0.0.1:59836 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 19:34:04.801854 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.799732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37828 (local address 127.17.18.125:46615)
0806 19:34:04.799949 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.799956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.800169 (+ 213us) server_negotiation.cc:407] Connection header received
0806 19:34:04.800414 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.800419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.800531 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.800632 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.801507 (+ 875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37828: BlockingRecv error: recv got EOF from 127.0.0.1:37828 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260806 19:34:04.809350 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.807161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37836 (local address 127.17.18.125:46615)
0806 19:34:04.807374 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.807382 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.807928 (+ 546us) server_negotiation.cc:407] Connection header received
0806 19:34:04.808134 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.808138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.808215 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.808312 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.809170 (+ 858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37836: BlockingRecv error: recv got EOF from 127.0.0.1:37836 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260806 19:34:04.818434 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.816161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37838 (local address 127.17.18.125:46615)
0806 19:34:04.816383 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.816391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.816921 (+ 530us) server_negotiation.cc:407] Connection header received
0806 19:34:04.817131 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.817137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.817239 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.817329 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.818170 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37838: BlockingRecv error: recv got EOF from 127.0.0.1:37838 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 19:34:04.828508 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.826158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37852 (local address 127.17.18.125:46615)
0806 19:34:04.826393 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.826400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.826973 (+ 573us) server_negotiation.cc:407] Connection header received
0806 19:34:04.827181 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.827186 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.827290 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.827388 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.828231 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37852: BlockingRecv error: recv got EOF from 127.0.0.1:37852 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260806 19:34:04.842378 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.839919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37868 (local address 127.17.18.125:46615)
0806 19:34:04.840188 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.840195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.840771 (+ 576us) server_negotiation.cc:407] Connection header received
0806 19:34:04.840976 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.840982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.841063 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.841155 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.842123 (+ 968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37868: BlockingRecv error: recv got EOF from 127.0.0.1:37868 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
W20260806 19:34:04.864528 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.862146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37880 (local address 127.17.18.125:46615)
0806 19:34:04.862383 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.862393 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.862994 (+ 601us) server_negotiation.cc:407] Connection header received
0806 19:34:04.863213 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.863220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.863301 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.863415 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.864261 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37880: BlockingRecv error: recv got EOF from 127.0.0.1:37880 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260806 19:34:04.903066 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.900706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.17.18.125:46615)
0806 19:34:04.900921 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.900927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.901315 (+ 388us) server_negotiation.cc:407] Connection header received
0806 19:34:04.901642 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.901651 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.901750 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.901838 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.902805 (+ 967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37890: BlockingRecv error: recv got EOF from 127.0.0.1:37890 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 19:34:04.973764 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:04.971481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37898 (local address 127.17.18.125:46615)
0806 19:34:04.971737 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:04.971743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:04.972062 (+ 319us) server_negotiation.cc:407] Connection header received
0806 19:34:04.972258 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:04.972263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:04.972343 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:04.972435 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:04.973518 (+ 1083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37898: BlockingRecv error: recv got EOF from 127.0.0.1:37898 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260806 19:34:05.108471 18246 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:05.106460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37912 (local address 127.17.18.125:46615)
0806 19:34:05.106716 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.106724 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.107072 (+ 348us) server_negotiation.cc:407] Connection header received
0806 19:34:05.107321 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.107326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.107406 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.107488 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:05.108258 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37912: BlockingRecv error: recv got EOF from 127.0.0.1:37912 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 19:34:05.157972 18365 catalog_manager.cc:1259] Loaded cluster ID: 2e9b2787c0cd481887fbe66c0b755201
I20260806 19:34:05.158105 18365 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: loading cluster ID for follower catalog manager: success
I20260806 19:34:05.161106 18365 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: acquiring CA information for follower catalog manager: success
I20260806 19:34:05.163435 18365 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 04d23fc85c2146cc88373d680b56f8a9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:34:05.246121 18384 catalog_manager.cc:1259] Loaded cluster ID: 2e9b2787c0cd481887fbe66c0b755201
I20260806 19:34:05.246235 18384 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: loading cluster ID for follower catalog manager: success
I20260806 19:34:05.248936 18384 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: acquiring CA information for follower catalog manager: success
I20260806 19:34:05.251062 18384 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f038291af910400c8f40ae19cbb389c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:34:05.374471 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:05.368524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37918 (local address 127.17.18.125:46615)
0806 19:34:05.368755 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.368760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.368922 (+ 162us) server_negotiation.cc:407] Connection header received
0806 19:34:05.369150 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.369155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.369422 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.369546 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:05.370051 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.370775 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.372238 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.372716 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.372829 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:05.373310 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:05.373934 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:05.374051 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:05.374168 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 19:34:05.374252 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260806 19:34:05.392745 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:05.386368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.17.18.124:42229)
0806 19:34:05.386889 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.386896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.386996 (+ 100us) server_negotiation.cc:407] Connection header received
0806 19:34:05.387300 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.387304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.387481 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.387661 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:05.388135 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.388889 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.390335 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.390761 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.390881 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:05.391463 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:05.392036 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:05.392185 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:05.392336 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 19:34:05.392433 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":264,"threads_started":1}
I20260806 19:34:05.419510 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:05.399657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59848 (local address 127.17.18.126:37663)
0806 19:34:05.412348 (+ 12691us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.412355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.412382 (+ 27us) server_negotiation.cc:407] Connection header received
0806 19:34:05.412536 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.412543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.412807 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.413023 (+ 216us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:05.413641 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.414629 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.416431 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.417079 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.417223 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:05.417904 (+ 681us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:05.418490 (+ 586us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:05.418586 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:05.419072 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 19:34:05.419182 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12530,"thread_start_us":12377,"threads_started":1}
I20260806 19:34:05.419627 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:05.400138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50806 (local address 127.17.18.124:42229)
0806 19:34:05.405146 (+ 5008us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.405155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.413179 (+ 8024us) server_negotiation.cc:407] Connection header received
0806 19:34:05.413498 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.413504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.413604 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.413684 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:05.414320 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.415422 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.417271 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.417920 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.418013 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:05.418646 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:05.418782 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:05.418858 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:05.419175 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 19:34:05.419266 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4797}
I20260806 19:34:05.419637 18246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:05.400125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37934 (local address 127.17.18.125:46615)
0806 19:34:05.400328 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:05.400336 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:05.412852 (+ 12516us) server_negotiation.cc:407] Connection header received
0806 19:34:05.413218 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:05.413224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:05.413322 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:05.413406 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:05.414420 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.415547 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.417732 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:05.418176 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:05.418311 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:05.418814 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:05.418939 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:05.419041 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:05.419252 (+ 211us) server_negotiation.cc:299] Negotiation successful
0806 19:34:05.419340 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 19:34:05.426030 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18044
I20260806 19:34:05.427182 18129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:05.554209 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18044
I20260806 19:34:05.586505 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18143
I20260806 19:34:05.587736 18231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:05.703111 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18143
I20260806 19:34:05.734700 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18250
I20260806 19:34:05.736001 18335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:05.849601 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18250
2026-08-06T19:34:05Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5159 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 19:34:05 dist-test-slave-f0tn krb5kdc[18537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 19:34:05 dist-test-slave-f0tn krb5kdc[18537](info): set up 2 sockets
Aug 06 19:34:05 dist-test-slave-f0tn krb5kdc[18537](info): commencing operation
krb5kdc: starting...
W20260806 19:34:07.137415 17481 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.002s sys 0.060s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/test-user.keytab.
Aug 06 19:34:07 dist-test-slave-f0tn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T19:34:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T19:34:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.18.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
Entry for principal kudu/127.17.18.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab.
I20260806 19:34:07.529490 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43037
--webserver_interface=127.17.18.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 19:34:07.911078 18554 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:07.911500 18554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:07.911619 18554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:07.911744 18554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:07.919762 18554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:07.919909 18554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:07.919997 18554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:07.920068 18554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:07.920166 18554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:07.931425 18554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.126.keytab
--principal=kudu/127.17.18.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.126:43037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.18.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:07.932938 18554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:07.934541 18554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:07.948042 18562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:07.948252 18561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:07.948011 18564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:07.948892 18554 server_base.cc:1034] running on GCE node
I20260806 19:34:07.949888 18554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:07.951550 18554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:07.952828 18554 hybrid_clock.cc:648] HybridClock initialized: now 1786044847952739 us; error 65 us; skew 500 ppm
I20260806 19:34:07.953243 18554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:07 dist-test-slave-f0tn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:07.956766 18554 init.cc:377] Logged in from keytab as kudu/127.17.18.126@KRBTEST.COM (short username kudu)
I20260806 19:34:07.958459 18554 webserver.cc:460] Webserver started at http://127.17.18.126:34757/ using document root <none> and password file <none>
I20260806 19:34:07.959220 18554 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:07.959319 18554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:07.959626 18554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:07.963022 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data/instance:
uuid: "a9ab0013d6c84112b373667370e5e1a3"
format_stamp: "Formatted at 2026-08-06 19:34:07 on dist-test-slave-f0tn"
server_key: "aeaa5068c0328b05ea9cef9bd4e16db8"
server_key_iv: "2fd8d8a7e5b71820813169f6354abe17"
server_key_version: "encryptionkey@0"
I20260806 19:34:07.963946 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance:
uuid: "a9ab0013d6c84112b373667370e5e1a3"
format_stamp: "Formatted at 2026-08-06 19:34:07 on dist-test-slave-f0tn"
server_key: "aeaa5068c0328b05ea9cef9bd4e16db8"
server_key_iv: "2fd8d8a7e5b71820813169f6354abe17"
server_key_version: "encryptionkey@0"
I20260806 19:34:07.970073 18554 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 19:34:07.974388 18573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:07.976039 18554 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 19:34:07.976279 18554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal
uuid: "a9ab0013d6c84112b373667370e5e1a3"
format_stamp: "Formatted at 2026-08-06 19:34:07 on dist-test-slave-f0tn"
server_key: "aeaa5068c0328b05ea9cef9bd4e16db8"
server_key_iv: "2fd8d8a7e5b71820813169f6354abe17"
server_key_version: "encryptionkey@0"
I20260806 19:34:07.976529 18554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:07.989219 18554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:07.994475 18554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:07.994796 18554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:08.016393 18554 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.126:43037
I20260806 19:34:08.016436 18644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.126:43037 every 8 connection(s)
I20260806 19:34:08.018047 18554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/data/info.pb
I20260806 19:34:08.019042 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18554
I20260806 19:34:08.019325 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-0/wal/instance
I20260806 19:34:08.019832 17481 external_mini_cluster.cc:1428] Setting key 84807a42ea18a12fc0b6c5b1fecb4792
I20260806 19:34:08.023545 18645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:08.031276 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:08 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.18.125@KRBTEST.COM; defaulting to no policy
I20260806 19:34:08.059943 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.035440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43037 (local address 127.0.0.1:39406)
0806 19:34:08.036514 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.036568 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:08.039344 (+ 2776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:08.040727 (+ 1383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:08.040733 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:08.041439 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:08.041878 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.041900 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.044207 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.044211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.045518 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.045535 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.046874 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.046882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.047048 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.047821 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:08.047848 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:08.050344 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:08.055085 (+ 4741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.055098 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.055111 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.055611 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.056134 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.056138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.056141 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.056325 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.057218 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:08.057226 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:08.057491 (+ 265us) client_negotiation.cc:769] Sending connection context
0806 19:34:08.057737 (+ 246us) client_negotiation.cc:240] Negotiation successful
0806 19:34:08.058502 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":184,"thread_start_us":472,"threads_started":1}
I20260806 19:34:08.059988 18648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.035433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39406 (local address 127.17.18.126:43037)
0806 19:34:08.037621 (+ 2188us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:08.037628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:08.037688 (+ 60us) server_negotiation.cc:407] Connection header received
0806 19:34:08.039877 (+ 2189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:08.039886 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:08.040395 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:08.040672 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:08.042146 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.043947 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.045695 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.046570 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.046786 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.050677 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:08.050690 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:08.050711 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:08.050762 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:08.054861 (+ 4099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.055801 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.055809 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.055811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.056006 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.056452 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.056456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.056458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.057058 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:08.057266 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:08.057903 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 19:34:08.058350 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":1961,"thread_start_us":1663,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.125@KRBTEST.COM" created.
I20260806 19:34:08.064576 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:08.066007 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.065452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48770)
0806 19:34:08.065668 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.065830 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 19:34:08.066349 18578 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
I20260806 19:34:08.068229 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.067735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48780)
0806 19:34:08.067927 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.068023 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 19:34:08.068480 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:44617: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
Entry for principal kudu/127.17.18.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab.
I20260806 19:34:08.110546 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:44617
--webserver_interface=127.17.18.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:34:08.117925 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } attempt: 1
I20260806 19:34:08.119441 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.118853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48792)
0806 19:34:08.119099 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.119272 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 19:34:08.120704 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.120240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48800)
0806 19:34:08.120414 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.120529 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 19:34:08.120970 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:44617: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
I20260806 19:34:08.189283 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } attempt: 2
I20260806 19:34:08.190771 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.190185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48814)
0806 19:34:08.190470 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.190599 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 19:34:08.192167 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.191694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48816)
0806 19:34:08.191899 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.191990 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260806 19:34:08.192401 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:44617: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
I20260806 19:34:08.283676 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } attempt: 3
I20260806 19:34:08.284972 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.284466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48830)
0806 19:34:08.284721 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.284822 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 19:34:08.286239 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.285792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48842)
0806 19:34:08.285966 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.286049 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 19:34:08.286438 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:44617: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
I20260806 19:34:08.429702 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } attempt: 4
I20260806 19:34:08.430938 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.430401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48844)
0806 19:34:08.430710 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.430801 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260806 19:34:08.432171 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.431733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48846)
0806 19:34:08.431916 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.431993 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260806 19:34:08.432396 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.125:44617: Network error: Client connection negotiation failed: client connection to 127.17.18.125:44617: connect: Connection refused (error 111)
W20260806 19:34:08.490732 18653 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:08.491135 18653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:08.491246 18653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:08.491369 18653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:08.499027 18653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:08.499154 18653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:08.499243 18653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:08.499312 18653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:08.499404 18653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:08.509864 18653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.125.keytab
--principal=kudu/127.17.18.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.125:44617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.18.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:08.511301 18653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:08.512755 18653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:08.527137 18665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:08.527173 18661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:08.527207 18663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:08.528038 18653 server_base.cc:1034] running on GCE node
I20260806 19:34:08.528878 18653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:08.530481 18653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:08.531754 18653 hybrid_clock.cc:648] HybridClock initialized: now 1786044848531663 us; error 60 us; skew 500 ppm
I20260806 19:34:08.532115 18653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:08 dist-test-slave-f0tn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044848, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:08.542322 18653 init.cc:377] Logged in from keytab as kudu/127.17.18.125@KRBTEST.COM (short username kudu)
I20260806 19:34:08.544183 18653 webserver.cc:460] Webserver started at http://127.17.18.125:34637/ using document root <none> and password file <none>
I20260806 19:34:08.544994 18653 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:08.545105 18653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:08.545499 18653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:08.548873 18653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data/instance:
uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b"
format_stamp: "Formatted at 2026-08-06 19:34:08 on dist-test-slave-f0tn"
server_key: "e7bea684226efff5203e2f1e75250842"
server_key_iv: "267972c09b56866e8459a1914979f7e2"
server_key_version: "encryptionkey@0"
I20260806 19:34:08.549855 18653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal/instance:
uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b"
format_stamp: "Formatted at 2026-08-06 19:34:08 on dist-test-slave-f0tn"
server_key: "e7bea684226efff5203e2f1e75250842"
server_key_iv: "267972c09b56866e8459a1914979f7e2"
server_key_version: "encryptionkey@0"
I20260806 19:34:08.555874 18653 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 19:34:08.559949 18675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:08.561691 18653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 19:34:08.561895 18653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal
uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b"
format_stamp: "Formatted at 2026-08-06 19:34:08 on dist-test-slave-f0tn"
server_key: "e7bea684226efff5203e2f1e75250842"
server_key_iv: "267972c09b56866e8459a1914979f7e2"
server_key_version: "encryptionkey@0"
I20260806 19:34:08.562145 18653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:08.594596 18653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:08.599455 18653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:08.599747 18653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:08.619297 18653 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.125:44617
I20260806 19:34:08.619318 18744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.125:44617 every 8 connection(s)
I20260806 19:34:08.620786 18653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/data/info.pb
I20260806 19:34:08.623521 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18653
I20260806 19:34:08.623860 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-1/wal/instance
I20260806 19:34:08.624560 17481 external_mini_cluster.cc:1428] Setting key cd948cae0844d5df0a1405345f0f2268
I20260806 19:34:08.626197 18745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:08.636439 18745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:08 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044848, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:08.664969 18747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.641066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39416 (local address 127.17.18.126:43037)
0806 19:34:08.641706 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:08.641713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:08.643342 (+ 1629us) server_negotiation.cc:407] Connection header received
0806 19:34:08.646480 (+ 3138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:08.646487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:08.646614 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:08.646755 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:08.649034 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.650183 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.652407 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.653089 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.653252 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.657672 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:08.657679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:08.657684 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:08.657742 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:08.661130 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.662240 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.662246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.662249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.662418 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.662875 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.662880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.662884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.663304 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:08.663468 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:08.664314 (+ 846us) server_negotiation.cc:299] Negotiation successful
0806 19:34:08.664569 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":334,"threads_started":1}
WARNING: no policy specified for kudu/127.17.18.124@KRBTEST.COM; defaulting to no policy
I20260806 19:34:08.665889 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.641980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43037 (local address 127.0.0.1:39416)
0806 19:34:08.643081 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.643146 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:08.645988 (+ 2842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:08.647164 (+ 1176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:08.647177 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:08.647918 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:08.648667 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.648705 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.650489 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.650495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.652145 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.652170 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.653486 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.653495 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.653772 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.654684 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:08.654713 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:08.657305 (+ 2592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:08.661348 (+ 4043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.661358 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.661410 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.662091 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.662550 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.662553 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.662555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.662747 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.663471 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:08.663479 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:08.663887 (+ 408us) client_negotiation.cc:769] Sending connection context
0806 19:34:08.664146 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 19:34:08.664611 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":433,"threads_started":1}
I20260806 19:34:08.667917 18745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.18.124@KRBTEST.COM" created.
Aug 06 19:34:08 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044848, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:08.685585 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.668742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48860)
0806 19:34:08.669040 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.669064 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:08.669165 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:08.670496 (+ 1331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:08.670500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:08.670939 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:08.671129 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.671139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.673014 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.673019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.673982 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.673997 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.675156 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.675161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.675456 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.676097 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:08.676116 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:08.678387 (+ 2271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:08.682739 (+ 4352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.682743 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.682747 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.683168 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.683691 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.683695 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.683698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.683881 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.684676 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:08.684680 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:08.684814 (+ 134us) client_negotiation.cc:769] Sending connection context
0806 19:34:08.684937 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 19:34:08.685185 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260806 19:34:08.686066 18751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.669090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.17.18.125:44617)
0806 19:34:08.669920 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:08.669928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:08.669962 (+ 34us) server_negotiation.cc:407] Connection header received
0806 19:34:08.670025 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:08.670033 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:08.670294 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:08.670475 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:08.671328 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.672851 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.674136 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.674964 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.675120 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.678657 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:08.678678 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:08.678703 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:08.678742 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:08.682545 (+ 3803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.683331 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.683342 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.683345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.683499 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.684005 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.684009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.684012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.684510 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:08.684746 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:08.685121 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 19:34:08.685454 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":458,"threads_started":1}
I20260806 19:34:08.688663 18745 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:08.690100 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.689526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58770)
0806 19:34:08.689776 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.689933 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260806 19:34:08.690470 18676 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.692508 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.692023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58772)
0806 19:34:08.692257 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.692362 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260806 19:34:08.692809 18745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
Entry for principal kudu/127.17.18.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab.
I20260806 19:34:08.716971 17481 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
/tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:32919
--webserver_interface=127.17.18.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.18.84:43265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 19:34:08.731670 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } attempt: 5
Aug 06 19:34:08 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:08.742172 18745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 1
I20260806 19:34:08.743389 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.742879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58782)
0806 19:34:08.743083 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.743217 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 19:34:08.744560 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.744105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58792)
0806 19:34:08.744300 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.744404 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 19:34:08.744863 18745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.747772 18751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.732557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48874 (local address 127.17.18.125:44617)
0806 19:34:08.732751 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:08.732757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:08.732782 (+ 25us) server_negotiation.cc:407] Connection header received
0806 19:34:08.732854 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:08.732858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:08.732958 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:08.733094 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:08.734244 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.735006 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.736596 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.737064 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.737169 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.741124 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:08.741130 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:08.741134 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:08.741192 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:08.745044 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.745908 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.745913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.745915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.746042 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:08.746428 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:08.746431 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:08.746433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:08.746733 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:08.746850 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:08.747316 (+ 466us) server_negotiation.cc:299] Negotiation successful
0806 19:34:08.747514 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 19:34:08.747844 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.732401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48874)
0806 19:34:08.732611 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.732632 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:08.732749 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:08.733192 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:08.733198 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:08.733764 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:08.734023 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.734036 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.735170 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.735175 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.736432 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:08.736450 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:08.737248 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:08.737254 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:08.737511 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:08.738201 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:08.738223 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:08.740843 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:08.745207 (+ 4364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.745213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.745217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.745800 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.746155 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:08.746160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:08.746163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:08.746330 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:08.746866 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:08.746871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:08.747050 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 19:34:08.747224 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 19:34:08.747521 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 19:34:08.748976 18645 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } has no permanent_uuid. Determining permanent_uuid...
I20260806 19:34:08.750141 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.749680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58800)
0806 19:34:08.749869 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.749968 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 19:34:08.751173 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.750769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58816)
0806 19:34:08.750937 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.751043 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 19:34:08.751384 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.802670 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 1
I20260806 19:34:08.804102 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.803459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58830)
0806 19:34:08.803727 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.803865 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 19:34:08.805490 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.804985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58834)
0806 19:34:08.805200 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.805300 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260806 19:34:08.805794 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.815382 18745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 2
I20260806 19:34:08.816905 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.816256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58842)
0806 19:34:08.816541 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.816691 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260806 19:34:08.818235 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.817765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58854)
0806 19:34:08.817934 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.818035 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 19:34:08.818601 18745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.874054 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 2
I20260806 19:34:08.875504 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.874857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58858)
0806 19:34:08.875134 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.875252 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260806 19:34:08.876637 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.876213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58864)
0806 19:34:08.876375 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.876477 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 19:34:08.876960 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.909855 18745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 3
I20260806 19:34:08.911319 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.910692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58880)
0806 19:34:08.910953 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.911082 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 19:34:08.912806 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.912209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58882)
0806 19:34:08.912513 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.912626 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
W20260806 19:34:08.913086 18745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:08.983218 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 3
I20260806 19:34:08.984647 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.984002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58896)
0806 19:34:08.984279 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.984410 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 19:34:08.985991 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:08.985482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58904)
0806 19:34:08.985716 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:08.985845 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260806 19:34:08.986239 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:09.056396 18745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 4
I20260806 19:34:09.057726 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.057107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58918)
0806 19:34:09.057427 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.057544 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 19:34:09.058859 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.058481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58928)
0806 19:34:09.058652 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.058744 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 19:34:09.059099 18745 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
W20260806 19:34:09.105908 18755 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 19:34:09.106317 18755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 19:34:09.106426 18755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 19:34:09.106554 18755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 19:34:09.114377 18755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 19:34:09.114511 18755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 19:34:09.114598 18755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 19:34:09.114671 18755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 19:34:09.114758 18755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 19:34:09.125360 18755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.18.84:43265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.18.126:43037,127.17.18.125:44617,127.17.18.124:32919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/krb5kdc/kudu_127.17.18.124.keytab
--principal=kudu/127.17.18.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.18.124:32919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.18.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 17:20:36 UTC on ccycloud.quasar-dgoebi.root.comops.site
build id 4570388
ASAN enabled
I20260806 19:34:09.126869 18755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 19:34:09.128302 18755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 19:34:09.141278 18761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:09.141309 18764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 19:34:09.141366 18762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 19:34:09.142129 18755 server_base.cc:1034] running on GCE node
I20260806 19:34:09.143002 18755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 19:34:09.144727 18755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 19:34:09.145996 18755 hybrid_clock.cc:648] HybridClock initialized: now 1786044849145905 us; error 51 us; skew 500 ppm
I20260806 19:34:09.146369 18755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044849, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 19:34:09.149981 18755 init.cc:377] Logged in from keytab as kudu/127.17.18.124@KRBTEST.COM (short username kudu)
I20260806 19:34:09.151579 18755 webserver.cc:460] Webserver started at http://127.17.18.124:41257/ using document root <none> and password file <none>
I20260806 19:34:09.152346 18755 fs_manager.cc:359] Metadata directory not provided
I20260806 19:34:09.152462 18755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 19:34:09.152801 18755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 19:34:09.156162 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data/instance:
uuid: "34403ed5e2a5474b8842d0a2277ac77d"
format_stamp: "Formatted at 2026-08-06 19:34:09 on dist-test-slave-f0tn"
server_key: "204b0b7a3891d26d18d22869cf345db3"
server_key_iv: "ed124f5d653486104d000b983e236b4a"
server_key_version: "encryptionkey@0"
I20260806 19:34:09.157102 18755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal/instance:
uuid: "34403ed5e2a5474b8842d0a2277ac77d"
format_stamp: "Formatted at 2026-08-06 19:34:09 on dist-test-slave-f0tn"
server_key: "204b0b7a3891d26d18d22869cf345db3"
server_key_iv: "ed124f5d653486104d000b983e236b4a"
server_key_version: "encryptionkey@0"
I20260806 19:34:09.163163 18755 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 19:34:09.163516 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 4
I20260806 19:34:09.164812 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.164295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58944)
0806 19:34:09.164533 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.164631 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 19:34:09.165979 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.165565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58960)
0806 19:34:09.165756 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.165849 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 19:34:09.166185 18645 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.18.124:32919: Network error: Client connection negotiation failed: client connection to 127.17.18.124:32919: connect: Connection refused (error 111)
I20260806 19:34:09.167872 18773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 19:34:09.169632 18755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 19:34:09.169875 18755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data,/tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal
uuid: "34403ed5e2a5474b8842d0a2277ac77d"
format_stamp: "Formatted at 2026-08-06 19:34:09 on dist-test-slave-f0tn"
server_key: "204b0b7a3891d26d18d22869cf345db3"
server_key_iv: "ed124f5d653486104d000b983e236b4a"
server_key_version: "encryptionkey@0"
I20260806 19:34:09.170125 18755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 19:34:09.188041 18755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 19:34:09.193080 18755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 19:34:09.193403 18755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 19:34:09.212028 18755 rpc_server.cc:307] RPC server started. Bound to: 127.17.18.124:32919
I20260806 19:34:09.212035 18849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.18.124:32919 every 8 connection(s)
I20260806 19:34:09.213584 18755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/data/info.pb
I20260806 19:34:09.217805 18850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 19:34:09.220958 17481 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu as pid 18755
I20260806 19:34:09.221161 17481 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNJ4JWZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786044445493736-17481-0/minicluster-data/master-2/wal/instance
I20260806 19:34:09.221693 17481 external_mini_cluster.cc:1428] Setting key 0a61215012bbf84732f80243e51e7799
I20260806 19:34:09.226411 18850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044849, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:09.247064 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.230276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39424 (local address 127.17.18.126:43037)
0806 19:34:09.230861 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.230868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.231488 (+ 620us) server_negotiation.cc:407] Connection header received
0806 19:34:09.231754 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.231759 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.231832 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.231935 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.233442 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.234177 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.235706 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.236327 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.236469 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.240189 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.240198 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.240203 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.240264 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.243579 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.244461 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.244467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.244470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.244662 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.245135 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.245140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.245143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.245546 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.245705 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.246370 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.246616 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":290,"threads_started":1}
I20260806 19:34:09.248171 18855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.230280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.126:43037 (local address 127.0.0.1:39424)
0806 19:34:09.231294 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.231352 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:09.231566 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:09.232035 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:09.232042 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:09.232917 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:09.233197 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.233208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.234368 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.234373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.235510 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.235523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.236552 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.236557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.236696 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.237429 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:09.237464 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:09.239936 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:09.243743 (+ 3807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.243755 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.243766 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.244318 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.244846 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.244849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.244852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.245013 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.245694 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:09.245703 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:09.245969 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 19:34:09.246254 (+ 285us) client_negotiation.cc:240] Negotiation successful
0806 19:34:09.246991 (+ 737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":91,"thread_start_us":556,"threads_started":1}
I20260806 19:34:09.248209 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.223912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58962 (local address 127.17.18.124:32919)
0806 19:34:09.224817 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.224834 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.224891 (+ 57us) server_negotiation.cc:407] Connection header received
0806 19:34:09.227140 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.227178 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.227863 (+ 685us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.228381 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.229967 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.232024 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.233486 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.234191 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.234391 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.239114 (+ 4723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.239127 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.239148 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.239193 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.242924 (+ 3731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.243771 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.243779 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.243781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.244008 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.244458 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.244463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.244466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.245252 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.245615 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.246237 (+ 622us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.246823 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":638,"spinlock_wait_cycles":20224,"thread_start_us":380,"threads_started":1}
I20260806 19:34:09.249965 18850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044849, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.126@KRBTEST.COM
I20260806 19:34:09.267997 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.250822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48878 (local address 127.17.18.125:44617)
0806 19:34:09.251379 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.251386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.251405 (+ 19us) server_negotiation.cc:407] Connection header received
0806 19:34:09.251470 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.251476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.251554 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.251672 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.252675 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.253839 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.255448 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.256112 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.256250 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.259952 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.259958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.259961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.260003 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.264473 (+ 4470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.265309 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.265314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.265316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.265525 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.266450 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.266454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.266456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.266806 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.266981 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.267387 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.267639 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":298,"threads_started":1}
I20260806 19:34:09.268061 18855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.250614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.125:44617 (local address 127.0.0.1:48878)
0806 19:34:09.251108 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.251128 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:09.251239 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:09.251748 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:09.251753 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:09.252281 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:09.252463 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.252472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.254034 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.254041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.255283 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.255297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.256289 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.256294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.256477 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.257147 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:09.257202 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:09.259624 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:09.264692 (+ 5068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.264697 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.264700 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.265174 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.265667 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.265674 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.265678 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.265898 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.266954 (+ 1056us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:09.266958 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:09.267139 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 19:34:09.267272 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 19:34:09.267649 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362}
I20260806 19:34:09.268666 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.251559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39438 (local address 127.17.18.126:43037)
0806 19:34:09.251771 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.251776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.251879 (+ 103us) server_negotiation.cc:407] Connection header received
0806 19:34:09.252028 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.252032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.252119 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.252223 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.253816 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.254867 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.256612 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.257178 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.257313 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.262232 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.262238 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.262242 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.262281 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.265091 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.266152 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.266157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.266159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.266308 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.266807 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.266813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.266816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.267235 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.267523 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.268088 (+ 565us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.268359 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 19:34:09.269589 18850 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044849, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.124@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.18.125@KRBTEST.COM
I20260806 19:34:09.284940 18855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.270523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58970)
0806 19:34:09.270810 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.270830 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:09.270950 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:09.271281 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:09.271286 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:09.271752 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:09.271901 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.271909 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.273177 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.273183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.274419 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.274432 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.275425 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.275431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.275689 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.276349 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:09.276371 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:09.278725 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:09.282386 (+ 3661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.282392 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.282396 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.282908 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.283346 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.283352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.283356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.283520 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.284054 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:09.284059 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:09.284253 (+ 194us) client_negotiation.cc:769] Sending connection context
0806 19:34:09.284392 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 19:34:09.284655 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188}
I20260806 19:34:09.285221 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.270596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.17.18.124:32919)
0806 19:34:09.270790 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.270796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.270904 (+ 108us) server_negotiation.cc:407] Connection header received
0806 19:34:09.271070 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.271075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.271153 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.271225 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.272057 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.273034 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.274565 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.275246 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.275381 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.278958 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.278965 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.278970 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.279011 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.282224 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.283045 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.283049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.283052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.283179 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.283632 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.283635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.283637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.283930 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.284043 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.284531 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.284875 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":82}
I20260806 19:34:09.287233 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.270753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.17.18.125:44617)
0806 19:34:09.270908 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.270913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.270965 (+ 52us) server_negotiation.cc:407] Connection header received
0806 19:34:09.271136 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.271146 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.271259 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.271355 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.272814 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.273865 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.275488 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.276068 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.276194 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.281038 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.281044 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.281048 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.281088 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.284122 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.285077 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.285083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.285087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.285243 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.285743 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.285747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.285749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.286104 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.286388 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.286667 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.286923 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 19:34:09.291692 18850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: Bootstrap starting.
I20260806 19:34:09.292884 17481 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 19:34:09.295666 18850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:09.297147 18850 log.cc:824] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:09.295543 18612 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a9ab0013d6c84112b373667370e5e1a3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39438
I20260806 19:34:09.300837 18850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: No bootstrap required, opened a new log
I20260806 19:34:09.312472 18850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.313011 18850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34403ed5e2a5474b8842d0a2277ac77d, State: Initialized, Role: FOLLOWER
I20260806 19:34:09.313596 18850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.314734 18858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.315137 18858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.316193 18850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:34:09.326877 18873 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:34:09.327031 18873 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:34:09.324695 18755 master_runner.cc:186] Error getting master registration for 127.17.18.126:43037: OK, instance_id { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" instance_seqno: 1786044848009824 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:34:09.338734 18755 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 19:34:09.358366 18745 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 5
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044848, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.125@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:34:09.376768 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.359149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58984)
0806 19:34:09.359472 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.359496 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:09.359650 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:09.360035 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:09.360041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:09.360612 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:09.360850 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.360865 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.362499 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.362505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.363941 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.363963 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.365114 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.365120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.365426 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.366177 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:09.366206 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:09.369443 (+ 3237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:09.373296 (+ 3853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.373302 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.373305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.373947 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.374500 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.374506 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.374510 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.374702 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.375650 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:09.375655 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:09.375834 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 19:34:09.376004 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 19:34:09.376371 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260806 19:34:09.376897 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.359387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58984 (local address 127.17.18.124:32919)
0806 19:34:09.359667 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.359673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.359697 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:34:09.359774 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.359779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.359862 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.359970 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.361031 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.362306 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.364132 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.364908 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.365043 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.369720 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.369725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.369729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.369770 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.373081 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.374126 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.374133 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.374138 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.374346 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.374868 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.374875 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.374878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.375499 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.375683 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.376159 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.376448 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 19:34:09.382692 18745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: Bootstrap starting.
I20260806 19:34:09.386307 18745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:09.387842 18745 log.cc:824] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:09.391172 18745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: No bootstrap required, opened a new log
I20260806 19:34:09.403067 18745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.403611 18745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd35a4c05ac4d62bf6ee2fa56a5c48b, State: Initialized, Role: FOLLOWER
I20260806 19:34:09.404290 18745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.406512 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.407455 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.407830 18745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: configured and running, proceeding with master startup.
W20260806 19:34:09.425942 18892 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 19:34:09.426127 18892 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 19:34:09.423720 18653 master_runner.cc:186] Error getting master registration for 127.17.18.126:43037: OK, instance_id { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" instance_seqno: 1786044848009824 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 19:34:09.437574 18653 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 19:34:09.443367 18645 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } attempt: 5
W20260806 19:34:09.445719 18782 tablet.cc:2369] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 19:34:09 dist-test-slave-f0tn krb5kdc[18537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786044847, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.18.126@KRBTEST.COM for kudu/127.17.18.124@KRBTEST.COM
I20260806 19:34:09.463933 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.444305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.18.124:32919 (local address 127.0.0.1:58998)
0806 19:34:09.444538 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 19:34:09.444562 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 19:34:09.444715 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 19:34:09.445550 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 19:34:09.445556 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 19:34:09.446129 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 19:34:09.446383 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.446399 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.448072 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.448080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.449752 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 19:34:09.449776 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.450935 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.450943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 19:34:09.451215 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.452002 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 19:34:09.452047 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 19:34:09.455393 (+ 3346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 19:34:09.460300 (+ 4907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.460308 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.460313 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.460935 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.461613 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 19:34:09.461620 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 19:34:09.461624 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 19:34:09.461924 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 19:34:09.462666 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 19:34:09.462671 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 19:34:09.462904 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 19:34:09.463084 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 19:34:09.463451 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 19:34:09.464526 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.444695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58998 (local address 127.17.18.124:32919)
0806 19:34:09.444899 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.444906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.444930 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:34:09.445008 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.445020 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.445142 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.445270 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.446629 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.447841 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.449954 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.450723 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.450880 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.455713 (+ 4833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.455722 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.455728 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.455786 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.460076 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.461191 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.461198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.461203 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.461456 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.462127 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.462134 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.462137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.462525 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.462696 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.463356 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.463875 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 19:34:09.471318 18645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: Bootstrap starting.
I20260806 19:34:09.476094 18645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: Neither blocks nor log segments found. Creating new log.
I20260806 19:34:09.477811 18645 log.cc:824] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: Log is configured to *not* fsync() on all Append() calls
I20260806 19:34:09.482712 18645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: No bootstrap required, opened a new log
I20260806 19:34:09.491247 18645 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.491757 18645 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ab0013d6c84112b373667370e5e1a3, State: Initialized, Role: FOLLOWER
I20260806 19:34:09.492460 18645 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.494110 18901 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.494885 18901 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.495505 18645 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 19:34:09.495594 18612 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 19:34:09.495828 18612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 0 FOLLOWER]: Advancing to term 1
W20260806 19:34:09.498373 18580 tablet.cc:2369] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:34:09.499683 18612 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.502561 18710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9ab0013d6c84112b373667370e5e1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b"
I20260806 19:34:09.503110 18710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:09.506920 18710 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ab0013d6c84112b373667370e5e1a3 in term 1.
I20260806 19:34:09.507908 18578 leader_election.cc:302] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fd35a4c05ac4d62bf6ee2fa56a5c48b, a9ab0013d6c84112b373667370e5e1a3; no voters:
I20260806 19:34:09.509794 18814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9ab0013d6c84112b373667370e5e1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "34403ed5e2a5474b8842d0a2277ac77d"
I20260806 19:34:09.510402 18814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [term 0 FOLLOWER]: Advancing to term 1
I20260806 19:34:09.514600 18814 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9ab0013d6c84112b373667370e5e1a3 in term 1.
I20260806 19:34:09.515609 18612 leader_election.cc:288] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7fd35a4c05ac4d62bf6ee2fa56a5c48b (127.17.18.125:44617), 34403ed5e2a5474b8842d0a2277ac77d (127.17.18.124:32919)
I20260806 19:34:09.522816 18901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 19:34:09.533187 18901 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [term 1 LEADER]: Becoming Leader. State: Replica: a9ab0013d6c84112b373667370e5e1a3, State: Running, Role: LEADER
I20260806 19:34:09.534395 18901 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } }
I20260806 19:34:09.543390 18911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ab0013d6c84112b373667370e5e1a3. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.544044 18911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:09.555488 18921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 19:34:09.570976 18921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 19:34:09.580104 18935 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260806 19:34:09.603093 18682 tablet.cc:2369] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 19:34:09.605242 18854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.556423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39452 (local address 127.17.18.126:43037)
0806 19:34:09.556662 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.556669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.570026 (+ 13357us) server_negotiation.cc:407] Connection header received
0806 19:34:09.570244 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.570250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.570345 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.570454 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.572730 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.574106 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.576390 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.577160 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.577275 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.581422 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.581430 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.581435 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.581532 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.585417 (+ 3885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.586374 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.586380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.586383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.586555 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.594010 (+ 7455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.594016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.594020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.594485 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.594794 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.604516 (+ 9722us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.604806 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 19:34:09.606740 18814 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [term 1 FOLLOWER]: Refusing update from remote peer a9ab0013d6c84112b373667370e5e1a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:34:09.608098 18853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.552294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.17.18.124:32919)
0806 19:34:09.552528 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.552535 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.564454 (+ 11919us) server_negotiation.cc:407] Connection header received
0806 19:34:09.566487 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.566495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.566621 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.566711 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.576555 (+ 9844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.577690 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.593605 (+ 15915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.594331 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.594434 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.598268 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.598274 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.598279 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.598328 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.602177 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.603096 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.603101 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.603105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.603287 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.605811 (+ 2524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.605818 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.605821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.606278 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.606572 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.607354 (+ 782us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.607723 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 19:34:09.608050 18911 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:34:09.612185 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:09.576197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.17.18.125:44617)
0806 19:34:09.576427 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.576433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.577602 (+ 1169us) server_negotiation.cc:407] Connection header received
0806 19:34:09.578653 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.578660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.578755 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.578835 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.582455 (+ 3620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.583523 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.597117 (+ 13594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:09.597874 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:09.598002 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:09.601921 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 19:34:09.601929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 19:34:09.601933 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 19:34:09.601994 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 19:34:09.607007 (+ 5013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.609410 (+ 2403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.609417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.609421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.609617 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 19:34:09.610108 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 19:34:09.610113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 19:34:09.610117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 19:34:09.610551 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 19:34:09.610850 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:09.611502 (+ 652us) server_negotiation.cc:299] Negotiation successful
0806 19:34:09.611779 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 19:34:09.619596 18710 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [term 1 FOLLOWER]: Refusing update from remote peer a9ab0013d6c84112b373667370e5e1a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 19:34:09.622085 18911 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 19:34:09.647399 18858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ab0013d6c84112b373667370e5e1a3. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.647755 18858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.652523 18939 mvcc.cc:205] Tried to move back new op lower bound from 7315639703957716992 to 7315639703713071104. Current Snapshot: MvccSnapshot[applied={T|T < 7315639703957716992}]
I20260806 19:34:09.656921 18937 mvcc.cc:205] Tried to move back new op lower bound from 7315639703957716992 to 7315639703713071104. Current Snapshot: MvccSnapshot[applied={T|T < 7315639703957716992}]
I20260806 19:34:09.682533 18858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.682873 18858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.685138 18901 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.685527 18901 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:09.690986 18921 catalog_manager.cc:1347] Generated new cluster ID: cd9a41a868a848959b3940154d7d4591
I20260806 19:34:09.691129 18921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 19:34:09.708557 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ab0013d6c84112b373667370e5e1a3. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.708956 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.727726 18911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.734794 18911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3 [sys.catalog]: This master's current role is: LEADER
I20260806 19:34:09.739962 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9ab0013d6c84112b373667370e5e1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9ab0013d6c84112b373667370e5e1a3" member_type: VOTER last_known_addr { host: "127.17.18.126" port: 43037 } } peers { permanent_uuid: "7fd35a4c05ac4d62bf6ee2fa56a5c48b" member_type: VOTER last_known_addr { host: "127.17.18.125" port: 44617 } } peers { permanent_uuid: "34403ed5e2a5474b8842d0a2277ac77d" member_type: VOTER last_known_addr { host: "127.17.18.124" port: 32919 } } }
I20260806 19:34:09.740329 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 19:34:09.742484 18921 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 19:34:09.744561 18921 catalog_manager.cc:1504] Loading token signing keys...
I20260806 19:34:09.788471 18921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9ab0013d6c84112b373667370e5e1a3: Generated new TSK 0
I20260806 19:34:09.790035 18921 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 19:34:09.920946 18853 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.909177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59014 (local address 127.17.18.124:32919)
0806 19:34:09.909400 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.909407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.917815 (+ 8408us) server_negotiation.cc:407] Connection header received
0806 19:34:09.918176 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.918183 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.918291 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.918378 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.920658 (+ 2280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59014: BlockingRecv error: recv got EOF from 127.0.0.1:59014 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 19:34:09.923158 18854 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.908817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39464 (local address 127.17.18.126:43037)
0806 19:34:09.909069 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.909076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.920335 (+ 11259us) server_negotiation.cc:407] Connection header received
0806 19:34:09.920863 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.920869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.920967 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.921060 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.922828 (+ 1768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39464: BlockingRecv error: recv got EOF from 127.0.0.1:39464 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 19:34:09.926285 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.917010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.17.18.125:44617)
0806 19:34:09.917269 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.917276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.924463 (+ 7187us) server_negotiation.cc:407] Connection header received
0806 19:34:09.924705 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.924711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.924806 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.924922 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.926001 (+ 1079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48896: BlockingRecv error: recv got EOF from 127.0.0.1:48896 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 19:34:09.933034 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.930381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48902 (local address 127.17.18.125:44617)
0806 19:34:09.930634 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.930642 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.931261 (+ 619us) server_negotiation.cc:407] Connection header received
0806 19:34:09.931510 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.931514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.931742 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.931848 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.932730 (+ 882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48902: BlockingRecv error: recv got EOF from 127.0.0.1:48902 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 19:34:09.939308 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.937405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48916 (local address 127.17.18.125:44617)
0806 19:34:09.937606 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.937612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.937928 (+ 316us) server_negotiation.cc:407] Connection header received
0806 19:34:09.938153 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.938157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.938230 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.938329 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.939106 (+ 777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48916: BlockingRecv error: recv got EOF from 127.0.0.1:48916 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 19:34:09.950165 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.945316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48930 (local address 127.17.18.125:44617)
0806 19:34:09.945578 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.945585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.948601 (+ 3016us) server_negotiation.cc:407] Connection header received
0806 19:34:09.948812 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.948818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.948907 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.948997 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.949901 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48930: BlockingRecv error: recv got EOF from 127.0.0.1:48930 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260806 19:34:09.965551 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.963145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48946 (local address 127.17.18.125:44617)
0806 19:34:09.963429 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.963437 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.963984 (+ 547us) server_negotiation.cc:407] Connection header received
0806 19:34:09.964200 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.964205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.964283 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.964378 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.965225 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48946: BlockingRecv error: recv got EOF from 127.0.0.1:48946 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260806 19:34:09.981105 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:09.978543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48948 (local address 127.17.18.125:44617)
0806 19:34:09.978788 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:09.978796 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:09.979392 (+ 596us) server_negotiation.cc:407] Connection header received
0806 19:34:09.979608 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:09.979613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:09.979736 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:09.979835 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:09.980772 (+ 937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48948: BlockingRecv error: recv got EOF from 127.0.0.1:48948 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260806 19:34:10.003064 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:10.000587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48954 (local address 127.17.18.125:44617)
0806 19:34:10.000830 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.000842 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.001454 (+ 612us) server_negotiation.cc:407] Connection header received
0806 19:34:10.001704 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.001708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.001808 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.001907 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:10.002804 (+ 897us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48954: BlockingRecv error: recv got EOF from 127.0.0.1:48954 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 19:34:10.047834 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:10.045098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48964 (local address 127.17.18.125:44617)
0806 19:34:10.045340 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.045346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.046011 (+ 665us) server_negotiation.cc:407] Connection header received
0806 19:34:10.046259 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.046266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.046408 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.046569 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:10.047519 (+ 950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48964: BlockingRecv error: recv got EOF from 127.0.0.1:48964 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 19:34:10.117640 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:10.115480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48972 (local address 127.17.18.125:44617)
0806 19:34:10.115729 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.115736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.116037 (+ 301us) server_negotiation.cc:407] Connection header received
0806 19:34:10.116222 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.116227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.116341 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.116479 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:10.117370 (+ 891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48972: BlockingRecv error: recv got EOF from 127.0.0.1:48972 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260806 19:34:10.251363 18856 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 19:34:10.249329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48988 (local address 127.17.18.125:44617)
0806 19:34:10.249568 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.249574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.249959 (+ 385us) server_negotiation.cc:407] Connection header received
0806 19:34:10.250155 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.250160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.250257 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.250391 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 19:34:10.251158 (+ 767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48988: BlockingRecv error: recv got EOF from 127.0.0.1:48988 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 19:34:10.329267 18873 catalog_manager.cc:1259] Loaded cluster ID: cd9a41a868a848959b3940154d7d4591
I20260806 19:34:10.329432 18873 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: loading cluster ID for follower catalog manager: success
I20260806 19:34:10.332216 18873 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: acquiring CA information for follower catalog manager: success
I20260806 19:34:10.334441 18873 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 34403ed5e2a5474b8842d0a2277ac77d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:34:10.428277 18892 catalog_manager.cc:1259] Loaded cluster ID: cd9a41a868a848959b3940154d7d4591
I20260806 19:34:10.428390 18892 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: loading cluster ID for follower catalog manager: success
I20260806 19:34:10.431107 18892 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: acquiring CA information for follower catalog manager: success
I20260806 19:34:10.433190 18892 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7fd35a4c05ac4d62bf6ee2fa56a5c48b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 19:34:10.520663 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:10.513161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.17.18.125:44617)
0806 19:34:10.513943 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.513947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.513968 (+ 21us) server_negotiation.cc:407] Connection header received
0806 19:34:10.514046 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.514051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.514267 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.514394 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:10.514903 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.515803 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.517617 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.518225 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.518358 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:10.519005 (+ 647us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:10.519812 (+ 807us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:10.519982 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:10.520219 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 19:34:10.520332 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628}
I20260806 19:34:10.539363 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:10.532722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59022 (local address 127.17.18.124:32919)
0806 19:34:10.533259 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.533266 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.533327 (+ 61us) server_negotiation.cc:407] Connection header received
0806 19:34:10.533672 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.533676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.533852 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.534018 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:10.534481 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.535237 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.536774 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.537314 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.537478 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:10.538064 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:10.538639 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:10.538783 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:10.538916 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 19:34:10.539011 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":259,"threads_started":1}
I20260806 19:34:10.554025 19057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:10.545959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.17.18.126:43037)
0806 19:34:10.547038 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.547044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.547068 (+ 24us) server_negotiation.cc:407] Connection header received
0806 19:34:10.547240 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.547246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.547997 (+ 751us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.548166 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:10.548832 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.549752 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.551588 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.551980 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.552095 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:10.552702 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:10.553249 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:10.553420 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:10.553569 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 19:34:10.553670 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947,"thread_start_us":829,"threads_started":1}
I20260806 19:34:10.554064 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:10.546034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59028 (local address 127.17.18.124:32919)
0806 19:34:10.546637 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.546645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.547406 (+ 761us) server_negotiation.cc:407] Connection header received
0806 19:34:10.547690 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.547696 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.547787 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.547881 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:10.548639 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.549638 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.551926 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.552487 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.552592 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:10.553305 (+ 713us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:10.553462 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:10.553544 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:10.553720 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 19:34:10.553801 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436}
I20260806 19:34:10.554980 18856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 19:34:10.547616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49006 (local address 127.17.18.125:44617)
0806 19:34:10.547809 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 19:34:10.547815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 19:34:10.548199 (+ 384us) server_negotiation.cc:407] Connection header received
0806 19:34:10.548509 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 19:34:10.548515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 19:34:10.548599 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 19:34:10.548696 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 19:34:10.549240 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.550178 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.552280 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 19:34:10.552771 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 19:34:10.552882 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 19:34:10.553410 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 19:34:10.553534 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 19:34:10.553619 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 19:34:10.553812 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 19:34:10.553898 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 19:34:10.558854 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18554
I20260806 19:34:10.560016 18639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:10.674103 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18554
W20260806 19:34:10.703176 18676 connection.cc:535] server connection from 127.0.0.1:48874 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 19:34:10.703670 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18653
I20260806 19:34:10.704933 18737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:10.821236 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18653
I20260806 19:34:10.852476 17481 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu pid 18755
I20260806 19:34:10.853945 18845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 19:34:10.968945 17481 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNJ4JWZ/build/asan/bin/kudu with pid 18755
2026-08-06T19:34:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5121 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10281 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (405376 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST